{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "gHNlIaljQI54"
   },
   "source": [
    "### Agentic SFT Data generation with CAMEL and finetuning Mistral models with Unsloth\n",
    "\n",
    "For more detailed usage information, please refer to our [cookbook](https://colab.research.google.com/drive/1lYgArBw7ARVPSpdwgKLYnp_NEXiNDOd-?usp=sharing)\n",
    "\n",
    "To run this, press \"*Runtime*\" and press \"*Run all*\" on a **free** Tesla T4 Google Colab instance!\n",
    "<div class=\"align-center\">\n",
    "  <a href=\"https://www.camel-ai.org/\"><img src=\"https://i.postimg.cc/KzQ5rfBC/button.png\"width=\"150\"></a>\n",
    "  <a href=\"https://discord.camel-ai.org\"><img src=\"https://i.postimg.cc/L4wPdG9N/join-2.png\"  width=\"150\"></a></a>\n",
    "  \n",
    "⭐ <i>Star us on [*Github*](https://github.com/camel-ai/camel), join our [*Discord*](https://discord.camel-ai.org) or follow our [*X*](https://x.com/camelaiorg)\n",
    "</div>\n",
    "\n",
    "CAMEL and Unsloth make an excellent pair. In this notebook we will combine the two to train a model to be proficient at content on a page\n",
    "\n",
    "You will learn how to do data generation with CAMEL, how to train, and how to run the model."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "ldplIxguQuTl"
   },
   "source": [
    "![SFT v2.png]()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "2eSvM9zX_2d3"
   },
   "outputs": [],
   "source": [
    "%%capture\n",
    "!pip install unsloth\n",
    "# Install CAMEL-AI with no optional dependencies\n",
    "!pip install camel-ai==0.2.16\n",
    "# Get Unsloth\n",
    "!pip install --upgrade --no-deps \"unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git@0de54572525788d09a6a9ef1efc7611e65dd7547\"\n",
    "!pip install firecrawl"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "r2v_X2fA0Df5"
   },
   "source": [
    "First we will set the OPENAI_API_KEY that will be used to generate the data.\n",
    "\n",
    "CAMEL supports many other models. See [here](https://docs.camel-ai.org/key_modules/models.html) for a list."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "gq4Q0u0ZTvGs",
    "outputId": "f9f35cb9-d54a-4f64-8f7e-0c090a7c75e9"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Enter your OpenAI API key: ··········\n",
      "Enter your Firecrawl API key: ··········\n"
     ]
    }
   ],
   "source": [
    "from getpass import getpass\n",
    "import os\n",
    "\n",
    "openai_api_key = getpass('Enter your OpenAI API key: ')\n",
    "os.environ[\"OPENAI_API_KEY\"] = openai_api_key\n",
    "\n",
    "# Generate an API key at https://www.firecrawl.dev/app/api-keys\n",
    "firecrawl_api_key = getpass('Enter your Firecrawl API key: ')\n",
    "os.environ[\"FIRECRAWL_API_KEY\"] = firecrawl_api_key"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "iP5-hPz-0T6x"
   },
   "source": [
    "Next we will setup our model for training using Unsloth."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 497,
     "referenced_widgets": [
      "afdac2c6f67049a9b00c7d8499198f4d",
      "196c370e59814c4d94b91fecce193e1f",
      "386534e2ee6245d4931abf5a9a366dec",
      "52e1ab786d8d4514907d3c9b519eea86",
      "2f4a07efa98f4243b6f780793820bd70",
      "04c4fc581add4f23b99ada998599a342",
      "4f71f21a05124dfdb2d29f64de18bc79",
      "7ae08cc6b65548189cff799d47b929a2",
      "c62a747103824874aade983876e872b4",
      "e7e2b3e9223c42798ba0a3a34eb1d71e",
      "d542ac82ac354efc8231698f59e91da8",
      "e47421fec52c494598cc4c6c49641030",
      "c9a6a1c8c96c4cdba555697372bafb74",
      "b89a1c85fa0d44d9ade2f2d149e84019",
      "63e2e4d767044da8b2c2caacecfa8b53",
      "e9d91ef8c01d42e6bf7cd4cf263026f4",
      "53b4571358fc49e881f7583475315de2",
      "7d8fb825409241fe8c854bf6635ed0c6",
      "77823f5661cd413c922db91a1883f3af",
      "7f9d7ebc992e4ffdaeb040d3a3b37b41",
      "fbd55bebf3644df692e661e02c5d9b7c",
      "2f7eba09d59342b2909b77f0339cb61e",
      "945b1d65759a46f896dac5dc510435f8",
      "4526ec1d4ec745b1bc49be760743bf45",
      "025aad4d520a4c12be40b1ec60965f78",
      "f97151ccc3124f7598acb926a0b70711",
      "0179fd870ce04ab78d916c4111cd79a8",
      "53f5d541916943569bc8b1b11f8af8e3",
      "ac212a92b6214af49730678dff56dd80",
      "7ebfbbf5b43a4ef5a951363d6701baaa",
      "2b3aa959d2d74d569b6e060dd8a65687",
      "4d9ad5bbe7ea487b849b589dd8405a86",
      "0d9bb083a6b7410a98be4058306c1b7e",
      "31faaf9cf2d2410a8189bc048d1f4759",
      "7b3946f6cd584e1fbd584dd350c1cc31",
      "ed44806f6ae34cbaa96da955530f25af",
      "040ab5df78b041ccbd8bd8d1eab1accc",
      "2592bd11c93e4efd9caaec3c041e4d40",
      "8daa9ffcf5874c68b82ba7d6bad2afd9",
      "8da629cd46b34cb5a7a533b31756caab",
      "9feb96a46c524916a4d77410a42573ff",
      "9ffe1c53f79e462a972456c9263011d5",
      "d1d69e6a21fd4a468c2103977d69a7fd",
      "49d898b037f340aa9f05bb1fd7511628",
      "a3ef9ae9c03e4562b0f1133305795cdf",
      "a64abdcfa37447749b8df3ee3ac3343c",
      "1a443295c0be4725869a94d9413d63fa",
      "bc6ee36df75b4c2bb40ebc1c7e030341",
      "0a8761d8502540439cda9ccb39e46d15",
      "8a72479983604802acb0450e2f075d72",
      "8af7e959a0894c4eaebcc756186969e4",
      "850910a24d794c60b518d6b3ce30c0f1",
      "a87e42ebb8a9415197c4cd2d24ab156d",
      "0ef0b079a60a481bb471db824c63614c",
      "32447f1a28fa435bbf4a943274047f06",
      "ed6e77f6ef45430fabd16bf3a5d6d4dd",
      "f8a429b61bea4a9b8c78f80e6b00d6da",
      "fd83b0e954bd4ce680cb14c0fbe2a9c7",
      "a9e83f8d7f3e4f8681ac6a23fabce60e",
      "acc7efcd0fe243c19633e91a754d65de",
      "c20970bea6f14a6eb13f9bb38732fb05",
      "b41dd2e291b64862aca912a7641cbffb",
      "af88ce43bc6c4537a6107733bfc6d8f5",
      "67eacf7bcab7461fad095a715ce1fb76",
      "d3ad2412060f48bdbf069711d20fa44d",
      "d9a964938105455ba2b4ff8e0f9bdb21"
     ]
    },
    "id": "QmUBVEnvCDJv",
    "outputId": "31c8b6a7-a713-46b5-d238-cef8fe7e471e"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.\n",
      "🦥 Unsloth Zoo will now patch everything to make training faster!\n",
      "==((====))==  Unsloth 2024.11.6: Fast Mistral patching. Transformers = 4.47.0.\n",
      "   \\\\   /|    GPU: Tesla T4. Max memory: 14.748 GB. Platform = Linux.\n",
      "O^O/ \\_/ \\    Pytorch: 2.5.1+cu121. CUDA = 7.5. CUDA Toolkit = 12.1.\n",
      "\\        /    Bfloat16 = FALSE. FA [Xformers = 0.0.28.post3. FA2 = False]\n",
      " \"-____-\"     Free Apache license: http://github.com/unslothai/unsloth\n",
      "Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored!\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "afdac2c6f67049a9b00c7d8499198f4d",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "model.safetensors:   0%|          | 0.00/4.13G [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "e47421fec52c494598cc4c6c49641030",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "generation_config.json:   0%|          | 0.00/155 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "945b1d65759a46f896dac5dc510435f8",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "tokenizer_config.json:   0%|          | 0.00/2.13k [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "31faaf9cf2d2410a8189bc048d1f4759",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "tokenizer.model:   0%|          | 0.00/493k [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "a3ef9ae9c03e4562b0f1133305795cdf",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "special_tokens_map.json:   0%|          | 0.00/438 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "ed6e77f6ef45430fabd16bf3a5d6d4dd",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "tokenizer.json:   0%|          | 0.00/1.80M [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unsloth: Offloading input_embeddings to disk to save VRAM\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/usr/local/lib/python3.10/dist-packages/unsloth/models/_utils.py:697: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.\n",
      "  offloaded_W = torch.load(filename, map_location = \"cpu\", mmap = True)\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unsloth: Offloading output_embeddings to disk to save VRAM\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Unsloth 2024.11.6 patched 32 layers with 32 QKV layers, 32 O layers and 32 MLP layers.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unsloth: Training embed_tokens in mixed precision to save VRAM\n",
      "Unsloth: Training lm_head in mixed precision to save VRAM\n"
     ]
    }
   ],
   "source": [
    "from unsloth import FastLanguageModel\n",
    "import torch\n",
    "max_seq_length = 4096\n",
    "dtype = None\n",
    "load_in_4bit = True\n",
    "\n",
    "model, tokenizer = FastLanguageModel.from_pretrained(\n",
    "    model_name = \"unsloth/mistral-7b-instruct-v0.2-bnb-4bit\",\n",
    "    max_seq_length = max_seq_length,\n",
    "    dtype = dtype,\n",
    "    load_in_4bit = load_in_4bit,\n",
    ")\n",
    "model = FastLanguageModel.get_peft_model(\n",
    "    model,\n",
    "    r = 16,\n",
    "    target_modules = [\"q_proj\", \"k_proj\", \"v_proj\", \"o_proj\",\n",
    "                      \"gate_proj\", \"up_proj\", \"down_proj\",\n",
    "                      \"embed_tokens\", \"lm_head\"],\n",
    "    lora_alpha = 16,\n",
    "    use_gradient_checkpointing = \"unsloth\",\n",
    "    random_state = 3407,\n",
    "    use_rslora = False,  # We support rank stabilized LoRA\n",
    "    loftq_config = None, # And LoftQ\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "RCb9quu7bcGE"
   },
   "source": [
    "Now as a control, lets see how this model does with our CAMEL-specific question"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "YqQz8vdrbbrF",
    "outputId": "5f19d578-56ef-4c01-a1ed-d0bd402f21c5"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[\"<s> ### Instruction:\\nExplain how can I stay up to date with the CAMEL community.\\n\\n### Input:\\n\\n\\n### Response:\\nTo stay up-to-date with the CAMEL community, you can follow these steps:\\n\\n1. **Join the CAMEL mailing list**: This is the primary communication channel for the CAMEL community. You can subscribe to the mailing list by sending an email to camel-users+subscribe@lists.apache.org. Once you're subscribed, you'll receive emails with important announcements, discussions, and updates related to CAMEL.\\n\\n2. **Follow the CAMEL blog**: The CAMEL project maintains a blog where they post news, releases, and other important information. You can follow the blog to stay informed about the latest developments in the CAMEL community. The blog can be found at https://camel.apache.org/blog.html.\\n\\n3. **Check the CAMEL website regularly**: The CAMEL website is a great resource for learning about new features, releases, and other news related to the project. Be sure to check the website regularly to stay informed.\\n\\n4. **Attend CAMEL events**: CAMEL holds regular events, including conferences and meetups, where you can learn from other CAMEL users and developers, and get the latest information about the project. Be sure to check the CAMEL website for upcoming events and consider attending if possible.\\n\\n5. **Engage with the community**: One of the best ways to stay up-to-date with the CAMEL community is to engage with other users and developers. You can do this by participating in discussions on the mailing list, contributing to the project, or attending meetups and conferences.\\n\\n6. **Follow CAMEL on social media**: CAMEL has a presence on various social media platforms, including Twitter and LinkedIn. Following these accounts can help you stay informed about the latest news and developments in the CAMEL community.\\n\\n7. **Subscribe to CAMEL newsletters**: CAMEL also sends out regular newsletters with important updates and announcements. You can subscribe to these newsletters by filling out the form on the CAMEL website.</s>\"]"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from camel.messages.conversion import AlpacaItem\n",
    "\n",
    "temp_model = FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",
    "inputs = tokenizer(\n",
    "[\n",
    "\n",
    "   AlpacaItem(\n",
    "       instruction=\"Explain how can I stay up to date with the CAMEL community.\",\n",
    "       input=\"\",\n",
    "       output=\"\", # leave this blank for generation!\n",
    "   ).to_string()\n",
    "\n",
    "], return_tensors = \"pt\").to(\"cuda\")\n",
    "\n",
    "outputs = temp_model.generate(**inputs, max_new_tokens = 512, use_cache = True)\n",
    "temp_model = None\n",
    "tokenizer.batch_decode(outputs)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "JshfcE5kdp2n"
   },
   "source": [
    "Note mistral 7b can handle this output format and follow instructions fine, though it is talking about the wrong project."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "_X_Nydp9K47x"
   },
   "source": [
    "### Data models\n",
    "We want to generate data in the Alpaca format, so we can use CAMEL's built-in AlpacaItem class which has some handy conversion functions for us.\n",
    "\n",
    "We will be using CAMEL's structured output to generate all of these items in one request, which is much faster and cheaper.\n",
    "\n",
    "\n",
    "Here we create a wrapper around the AlpacaItem to help the model know how many have been generated as it's going along, and another wrapper class that represents a list of these."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "TdJnqzXWuAUK"
   },
   "outputs": [],
   "source": [
    "from pydantic import BaseModel\n",
    "\n",
    "class NumberedAlpacaItem(BaseModel):\n",
    "    number: int\n",
    "    item: AlpacaItem\n",
    "\n",
    "\n",
    "class AlpacaItemResponse(BaseModel):\n",
    "    \"\"\"\n",
    "    Represents an instruction-response item in the Alpaca format.\n",
    "    \"\"\"\n",
    "    items: list[NumberedAlpacaItem]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "vITh0KVJ10qX"
   },
   "source": [
    "<a name=\"Data\"></a>\n",
    "### Data generation\n",
    "Next we define our data generation function. It takes a source content, and generates a list of instruction-input-response triplets around it.\n",
    "\n",
    "We will use this later to train our model to be proficient with the source content."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "mBno-K2rTCfS"
   },
   "outputs": [],
   "source": [
    "from typing import List\n",
    "from camel.loaders import Firecrawl\n",
    "from camel.models import ModelFactory\n",
    "from camel.types import ModelPlatformType, ModelType\n",
    "from camel.configs import ChatGPTConfig\n",
    "from camel.agents import ChatAgent\n",
    "import json\n",
    "\n",
    "\n",
    "def generate_alpaca_items(content: str, n_items: int, start_num: int = 1, examples: List[AlpacaItem] = None) -> List[AlpacaItem]:\n",
    "    system_msg = \"\"\"\n",
    "You are an AI assistant generating detailed, accurate responses based on the provided content.\n",
    "You will be given a reference content, and you must generate a specific number of AlpacaItems.\n",
    "These are instruction-input-response triplets, where the input is the context or examples.\n",
    "\n",
    "Add a number to the items to keep track of the order. Generate exactly that many.\n",
    "\n",
    "For each instruction, imagine but do not include a real world scenario and real user in that scenario to inform realistic and varied instructions. Avoid common sense questions and answers.\n",
    "\n",
    "Include multiple lines in the output as appropriate to provide sufficient detail. Cite the most relevant context verbatim in output fields, do not omit anything important.\n",
    "\n",
    "Leave the input field blank.\n",
    "\n",
    "Ensure all of the most significant parts of the context are covered.\n",
    "\n",
    "Start with open ended instructions, then move to more specific ones. Consider the starting number for an impression of what has already been generated.\n",
    "    \"\"\"\n",
    "\n",
    "    examples_str = \"\"\n",
    "    if examples:\n",
    "        examples_str = \"\\n\\nHere are some example items for reference:\\n\" + \\\n",
    "            \"\\n\".join(ex.model_dump_json() for ex in examples)\n",
    "\n",
    "    model = ModelFactory.create(\n",
    "        model_platform=ModelPlatformType.OPENAI,\n",
    "        model_type=ModelType.GPT_4O_MINI,\n",
    "        model_config_dict=ChatGPTConfig(\n",
    "            temperature=0.6, response_format=AlpacaItemResponse\n",
    "        ).as_dict(),\n",
    "    )\n",
    "\n",
    "    agent = ChatAgent(\n",
    "        system_message=system_msg,\n",
    "        model=model,\n",
    "    )\n",
    "\n",
    "    prompt = f\"Content reference:\\n{content}{examples_str}\\n\\n Generate {n_items} AlpacaItems. The first should start numbering at {start_num}.\"\n",
    "    response = agent.step(prompt)\n",
    "\n",
    "    # Parse the generated JSON to our wrapper class\n",
    "    alpaca_items = [n_item.item for n_item in\n",
    "                    AlpacaItemResponse.\n",
    "                    model_validate_json(response.msgs[0].content).items]\n",
    "\n",
    "    return alpaca_items\n",
    "\n",
    "\n",
    "def save_json(data: List, filename: str):\n",
    "    with open(filename, 'w', encoding='utf-8') as f:\n",
    "        json.dump([entry.model_dump() for entry in data], f, indent=2,\n",
    "                  ensure_ascii=False)\n",
    "\n",
    "\n",
    "# Few shot examples to ensure the right amount of detail\n",
    "examples = [\n",
    "    AlpacaItem(\n",
    "        instruction=\"Explain the process for sprint planning and review in CAMEL.\",\n",
    "        input=\"\",\n",
    "        output=\"The process for sprint planning and review in CAMEL includes:\\n1. **Sprint Duration**: Each sprint lasts two weeks for development and one week for review.\\n2. **Planning Meeting**: Conducted biweekly, where the founder highlights the sprint goal and developers select items for the sprint.\\n3. **Review Meeting**: Stakeholders review the delivered features and provide feedback on the work completed during the sprint.\"\n",
    "    )\n",
    "]\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "AqdoebfqMxb2"
   },
   "source": [
    "# Point to content and generate data!\n",
    "Now we point to the content that we wish to generate SFT data around and use CAMEL's Firecrawl integration to get this content in a nice markdown format.\n",
    "\n",
    "You can get a Firecrawl API key from [here](https://www.firecrawl.dev/app/api-keys)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "LxkdPzNVMvmH",
    "outputId": "8ab9ac17-2bd6-412d-c0b3-0d48dc235567"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Generated 50 items\n",
      "Generated 50 items\n",
      "Generated 50 items\n",
      "Generated 50 items\n",
      "Generated 50 items\n",
      "Generated 40 items\n",
      "[AlpacaItem(instruction='What is the purpose of code reviews in CAMEL?', input='', output='The purpose of code reviews in CAMEL includes:\\n- **Maintain Code Quality**: Ensuring that the codebase remains clean, readable, and maintainable.\\n- **Knowledge Sharing**: Facilitating knowledge sharing among contributors and helping new contributors learn best practices.\\n- **Bug Prevention**: Catching potential bugs and issues before they are merged into the main branch.\\n- **Consistency**: Ensuring consistency in style, design patterns, and architecture across the project.'), AlpacaItem(instruction='Describe the process for submitting a cookbook in CAMEL.', input='', output='The process for submitting a cookbook in CAMEL includes:\\n1. **Writing the Cookbook**: Use the provided template in Google Colab to write the cookbook entries, ensuring correctness and clear explanations.\\n2. **Reviewing the Cookbook**: The initial draft is reviewed in Colab, focusing on accuracy, clarity, and structure.\\n3. **Submitting the Cookbook**: Once finalized, download the Colab notebook as a .ipynb file and create a pull request to integrate it into the repository.'), AlpacaItem(instruction='What should contributors do if they want to fix a bug in CAMEL?', input='', output='If a contributor wants to fix a bug in CAMEL, they should:\\n- Add a relevant unit test when possible, ideally found in the `test` directory.\\n- Update any affected example console scripts in the `examples` directory, Gradio demos in the `apps` directory, and documentation in the `docs` directory.\\n- Ensure that the pull request mentions any related issues and tags the relevant maintainers.'), AlpacaItem(instruction='How are the communication channels organized in CAMEL?', input='', output='The communication channels in CAMEL are organized as follows:\\n- **Discord**: A primary channel for real-time communication and community engagement.\\n- **WeChat**: Available for Chinese speakers through a QR code.\\n- **Slack**: For more structured discussions and updates within the team.'), AlpacaItem(instruction='What are the key principles for writing docstrings in CAMEL?', input='', output='The key principles for writing docstrings in CAMEL include:\\n1. Use the triple-quoted string with `r\"\"\"` to prevent issues with special characters.\\n2. Provide a brief class or method description that summarizes its purpose and functionality.\\n3. Document parameters in the `Args` section, including parameter names, types, descriptions, and default values.'), AlpacaItem(instruction='What is the Fork-and-Pull-Request workflow in CAMEL?', input='', output='The Fork-and-Pull-Request workflow in CAMEL involves:\\n- Forking the repository to create a personal copy.\\n- Making changes to the forked repository.\\n- Opening a pull request to propose the changes to the original repository, ensuring that all relevant issues are mentioned and maintainers are tagged.'), AlpacaItem(instruction='Explain the guidelines for contributing to the CAMEL codebase.', input='', output='Guidelines for contributing to the CAMEL codebase include:\\n- Follow the Fork-and-Pull-Request workflow.\\n- Ensure pull requests pass formatting, linting, and testing checks.\\n- Mention any related issues and tag relevant maintainers.\\n- Provide thorough documentation and testing for any changes made.'), AlpacaItem(instruction='What should contributors do to ensure high-quality cookbook entries?', input='', output='To ensure high-quality cookbook entries, contributors should:\\n- Use the provided template in Google Colab for uniformity.\\n- Verify that all LLM-generated responses are correct through real code execution.\\n- Provide clear explanations of the code and its purpose.'), AlpacaItem(instruction='What is the procedure for running tests in CAMEL?', input='', output='The procedure for running tests in CAMEL includes:\\n- Use the command `pytest .` to run all tests, including those that use the OpenAI API.\\n- For local isolated unit and integration tests, use `pytest --fast-test-mode .`.'), AlpacaItem(instruction='How does CAMEL handle project management and workflow?', input='', output='CAMEL manages its project through a structured workflow that includes:\\n- Issue creation and pull requests (PRs).\\n- Sprint planning and reviews.\\n- Regular updates on issues through labels to keep things organized.'), AlpacaItem(instruction='What are the principles for contributing to documentation in CAMEL?', input='', output='Principles for contributing to documentation in CAMEL include:\\n- Providing comprehensive documentation for all classes and methods.\\n- Ensuring high-quality documentation coverage generated automatically by Sphinx.'), AlpacaItem(instruction='What are the steps for building documentation locally in CAMEL?', input='', output='To build documentation locally in CAMEL, follow these steps:\\n1. Change to the `docs` directory.\\n2. Execute `make html` to generate the HTML documentation.'), AlpacaItem(instruction='What are the common pitfalls to avoid when submitting a pull request?', input='', output='Common pitfalls to avoid when submitting a pull request include:\\n- Submitting large PRs; instead, break down changes into smaller, manageable PRs.\\n- Ignoring feedback from reviewers; address all feedback provided.'), AlpacaItem(instruction='How does CAMEL ensure code quality during reviews?', input='', output='CAMEL ensures code quality during reviews by:\\n- Checking for functionality, readability, and consistency with coding standards.\\n- Providing constructive feedback and requiring that changes are addressed before approval.'), AlpacaItem(instruction='What is the significance of using the `logger` instead of `print` in CAMEL?', input='', output='Using the `logger` instead of `print` in CAMEL is significant because:\\n- It ensures consistent, configurable, and professional logging.\\n- It allows for different logging levels (info, debug, error) to be used appropriately.'), AlpacaItem(instruction='What steps should be taken to update dependencies in CAMEL?', input='', output='To update dependencies in CAMEL, you should:\\n- Modify the `pyproject.toml` file as needed.\\n- Run `poetry lock` to synchronize the dependencies with the lock file.'), AlpacaItem(instruction='Describe the role of the community in contributing to CAMEL.', input='', output='The community plays a crucial role in contributing to CAMEL by:\\n- Participating in discussions on Discord and other communication platforms.\\n- Providing feedback, reporting issues, and contributing code and documentation.'), AlpacaItem(instruction='What are the guidelines for contributing to the code reviews in CAMEL?', input='', output='Guidelines for contributing to code reviews in CAMEL include:\\n- Timely reviews to keep the project moving.\\n- Providing clear and constructive feedback.\\n- Ensuring that only code meeting the necessary criteria is approved.'), AlpacaItem(instruction='How can someone join the CAMEL community?', input='', output='To join the CAMEL community, you can:\\n- Join the Discord server for real-time communication.\\n- Participate in developer meetings scheduled for English and Chinese speakers.'), AlpacaItem(instruction='What is the process for sprint planning in CAMEL?', input='', output='The sprint planning process in CAMEL includes:\\n- A biweekly meeting where the founder highlights the sprint goal.\\n- Developers choose items from the backlog to work on during the sprint.'), AlpacaItem(instruction='What should be included in the `Args` section of a docstring?', input='', output=\"In the `Args` section of a docstring, you should include:\\n- Parameter Name: Matching the function signature.\\n- Type: The type of the parameter (e.g., `int`, `str`).\\n- Description: A brief explanation of the parameter's role.\\n- Default Value: Indicate default values appropriately.\"), AlpacaItem(instruction='How should contributors handle feedback during code reviews?', input='', output='Contributors should handle feedback during code reviews by:\\n- Addressing all feedback provided by reviewers.\\n- Engaging in discussions regarding any feedback they do not agree with.'), AlpacaItem(instruction='What actions should be taken when creating a new issue in CAMEL?', input='', output='When creating a new issue in CAMEL, you should:\\n- Ensure the issue is focused on a specific bug, improvement, or feature.\\n- Provide a proper title and fill in required information, including labels and milestones.'), AlpacaItem(instruction='What is the importance of ensuring correctness in LLM-generated responses?', input='', output='Ensuring correctness in LLM-generated responses is important because:\\n- It maintains the reliability and accuracy of the cookbook entries.\\n- Users depend on correct information for implementing features correctly.'), AlpacaItem(instruction='What is the significance of logging in CAMEL?', input='', output='The significance of logging in CAMEL includes:\\n- Providing a consistent way to track application behavior.\\n- Allowing developers to troubleshoot issues effectively.'), AlpacaItem(instruction='What are the main communication channels available for CAMEL contributors?', input='', output='The main communication channels available for CAMEL contributors are:\\n- Discord for real-time discussions.\\n- WeChat for Chinese speakers.\\n- Slack for structured communication.'), AlpacaItem(instruction='Explain the significance of the `pre-commit` hook in CAMEL.', input='', output='The significance of the `pre-commit` hook in CAMEL is:\\n- It automatically formats and lints code before each commit.\\n- It helps maintain code quality and consistency across contributions.'), AlpacaItem(instruction='What principles help ensure high-quality contributions to the CAMEL cookbook?', input='', output='Principles that help ensure high-quality contributions to the CAMEL cookbook include:\\n- Using the provided template for uniformity.\\n- Verifying the correctness of LLM-generated responses.\\n- Providing clear and concise explanations.'), AlpacaItem(instruction='What is the recommended approach for conducting code reviews in CAMEL?', input='', output='The recommended approach for conducting code reviews in CAMEL includes:\\n- Checking for functionality, readability, and style compliance.\\n- Providing constructive feedback and facilitating knowledge sharing.'), AlpacaItem(instruction='How can contributors ensure their code is maintainable?', input='', output='Contributors can ensure their code is maintainable by:\\n- Writing clean, readable code with appropriate comments.\\n- Structuring code in a way that makes future changes easy.'), AlpacaItem(instruction='What are the steps for running coverage reports in CAMEL?', input='', output='The steps for running coverage reports in CAMEL include:\\n1. Erase previous coverage data with `coverage erase`.\\n2. Run tests with coverage using `coverage run --source=. -m pytest .`.\\n3. Generate the HTML report with `coverage html`.'), AlpacaItem(instruction='What guidelines should be followed for naming variables in CAMEL?', input='', output='Guidelines for naming variables in CAMEL include:\\n- Avoid abbreviations to prevent ambiguity.\\n- Use clear, descriptive names that convey meaning.'), AlpacaItem(instruction='What steps should be taken to create a pull request in CAMEL?', input='', output='To create a pull request in CAMEL, you should:\\n- Go to the GitHub Pulls page and create a new PR.\\n- Ensure the PR has a proper title and links to the related issue.\\n- Update the Reviewers, Assignees, and Labels as necessary.'), AlpacaItem(instruction='How does CAMEL handle sprint reviews?', input='', output='CAMEL handles sprint reviews by:\\n- Conducting a review meeting to gather feedback on delivered features.\\n- Identifying areas for improvement based on stakeholder input.'), AlpacaItem(instruction='What is the purpose of the `chore` label in CAMEL?', input='', output=\"The purpose of the `chore` label in CAMEL is to categorize maintenance tasks that do not affect the code's functionality, such as updating dependencies or cleaning up the codebase.\"), AlpacaItem(instruction=\"What is the process for ensuring reproducibility in CAMEL's cookbook?\", input='', output=\"The process for ensuring reproducibility in CAMEL's cookbook includes:\\n- Validating that all code can be executed to produce the same results.\\n- Providing clear instructions and context in the cookbook entries.\"), AlpacaItem(instruction='What are the benefits of using Google Colab for cookbook contributions?', input='', output='The benefits of using Google Colab for cookbook contributions include:\\n- The ability to run interactive code and explanations side-by-side.\\n- Easy sharing and collaboration on cookbook entries.'), AlpacaItem(instruction='What is the significance of maintaining high-quality documentation in CAMEL?', input='', output='The significance of maintaining high-quality documentation in CAMEL includes:\\n- Helping users understand how to use the project effectively.\\n- Ensuring that contributors can easily navigate and contribute to the codebase.'), AlpacaItem(instruction='What should be the focus of the sprint planning meeting in CAMEL?', input='', output='The focus of the sprint planning meeting in CAMEL should be:\\n- Defining what can be delivered in the sprint and how it will be achieved.\\n- Allowing developers to select items from the backlog aligned with the sprint goal.'), AlpacaItem(instruction='What is the role of unit tests in contributions to CAMEL?', input='', output='The role of unit tests in contributions to CAMEL is to:\\n- Ensure that new features are working as intended.\\n- Catch potential bugs early in the development process.'), AlpacaItem(instruction='What actions should be taken if a contributor finds outdated issues in CAMEL?', input='', output='If a contributor finds outdated issues in CAMEL, they should:\\n- Notify the maintainers so that the issues can be reviewed and updated accordingly.'), AlpacaItem(instruction='Explain the importance of clarity in code documentation.', input='', output='The importance of clarity in code documentation includes:\\n- Helping other developers understand the purpose and functionality of the code.\\n- Reducing the learning curve for new contributors.'), AlpacaItem(instruction='What is the significance of the `fix` label in CAMEL?', input='', output='The significance of the `fix` label in CAMEL is to indicate that a pull request addresses a bug or issue in the codebase, helping to categorize and track bug fixes.'), AlpacaItem(instruction='What should contributors do to ensure their code is thoroughly tested?', input='', output='To ensure their code is thoroughly tested, contributors should:\\n- Write unit tests that cover all new features and critical functionality.\\n- Ensure all tests pass before submitting a pull request.'), AlpacaItem(instruction='What is the purpose of the `docs` label in CAMEL?', input='', output=\"The purpose of the `docs` label in CAMEL is to categorize pull requests that involve updates or improvements to the project's documentation.\"), AlpacaItem(instruction='How can contributors improve the accessibility of their contributions?', input='', output='Contributors can improve the accessibility of their contributions by:\\n- Providing context for technical terms and concepts.\\n- Writing documentation that is clear and easy to follow for users of all skill levels.'), AlpacaItem(instruction='What are the benefits of having a structured workflow in CAMEL?', input='', output='The benefits of having a structured workflow in CAMEL include:\\n- Improved organization and clarity in project management.\\n- Enhanced collaboration among contributors and maintainers.'), AlpacaItem(instruction='What should contributors do if they encounter challenges during the setup process?', input='', output='If contributors encounter challenges during the setup process, they should reach out to a maintainer for assistance to ensure a smooth experience.'), AlpacaItem(instruction='What is the role of feedback in the code review process?', input='', output='The role of feedback in the code review process is to:\\n- Help contributors improve their code quality and adhere to project standards.\\n- Facilitate knowledge sharing and best practices among team members.'), AlpacaItem(instruction='What is the significance of using the `style` label in CAMEL?', input='', output='The significance of using the `style` label in CAMEL is to categorize pull requests that involve changes to code formatting or styling, ensuring consistency across the codebase.'), AlpacaItem(instruction='What steps should be followed to contribute to the CAMEL project?', input='', output=\"To contribute to the CAMEL project, follow these steps:\\n1. **Join the Community**: Engage with the CAMEL community via Discord or other communication channels.\\n2. **Choose a Contribution Type**: Decide whether you want to add features, fix bugs, improve documentation, or write cookbooks.\\n3. **Fork the Repository**: Use the Fork-and-Pull-Request workflow if you're a community contributor.\\n4. **Make Changes**: Implement your changes in a separate branch.\\n5. **Create a Pull Request**: Link your PR to any relevant issues and ensure it passes all checks.\"), AlpacaItem(instruction='Describe the process for reviewing cookbooks in CAMEL.', input='', output='The process for reviewing cookbooks in CAMEL includes:\\n1. **Review in Colab**: Leave comments and suggestions directly in the Colab document.\\n2. **Focus Areas**: Reviewers check for accuracy, clarity, structure, and formatting.\\n3. **Feedback Process**: Reviewers leave comments, and contributors address these comments and update the Colab file accordingly.'), AlpacaItem(instruction='What guidelines should be followed when writing docstrings in CAMEL?', input='', output='When writing docstrings in CAMEL, follow these guidelines:\\n1. Use `r\"\"\"` for the docstring to avoid issues with special characters.\\n2. Provide a brief summary followed by parameter documentation in an `Args` section.\\n3. Keep lines under 79 characters and ensure clear, concise descriptions.'), AlpacaItem(instruction=\"Explain the purpose of the CAMEL project's license.\", input='', output=\"The purpose of the CAMEL project's license, which is Apache 2.0, is to:\\n1. Allow users to freely use, modify, and distribute the software.\\n2. Protect contributors by ensuring that their contributions are also licensed under the same terms.\"), AlpacaItem(instruction='What is the procedure for submitting a cookbook to CAMEL?', input='', output='The procedure for submitting a cookbook to CAMEL involves:\\n1. **Download the Cookbook**: After finalizing the Colab notebook, download it as a .ipynb file.\\n2. **Create a Pull Request**: Open a PR to add the cookbook to the docs folder, including the .ipynb file and any necessary documentation.'), AlpacaItem(instruction='How can contributors ensure reproducibility in their cookbook entries?', input='', output='To ensure reproducibility in cookbook entries, contributors should:\\n1. Verify that all code is executable and generates consistent results.\\n2. Provide clear instructions and context for users to replicate the outcomes.'), AlpacaItem(instruction='What are the key principles for writing high-quality cookbook entries?', input='', output='The key principles for writing high-quality cookbook entries include:\\n1. Ensuring accuracy in code and explanations.\\n2. Maintaining high-quality formatting and structure.\\n3. Making the content accessible to a wide range of users.'), AlpacaItem(instruction='Describe the common actions that should be taken when updating dependencies in CAMEL.', input='', output='Common actions when updating dependencies in CAMEL include:\\n1. Modifying the `pyproject.toml` file as needed.\\n2. Running `poetry lock` to synchronize the dependencies with the lock file.'), AlpacaItem(instruction='What is the function of the `logger` in CAMEL?', input='', output='The function of the `logger` in CAMEL is to:\\n1. Provide a consistent and configurable way to log messages instead of using `print` statements.\\n2. Allow different logging levels (e.g., info, debug) for better control over output.'), AlpacaItem(instruction='How should contributors handle large pull requests in CAMEL?', input='', output='Contributors should handle large pull requests by:\\n1. Breaking them down into smaller, manageable pieces.\\n2. Ensuring that each PR focuses on a specific change or feature.'), AlpacaItem(instruction='What are the benefits of following the Fork-and-Pull-Request workflow in CAMEL?', input='', output='The benefits of following the Fork-and-Pull-Request workflow in CAMEL include:\\n1. Allowing contributors to work independently on their changes.\\n2. Facilitating code review and collaboration before merging changes into the main branch.'), AlpacaItem(instruction='Explain the significance of having a clear issue description when creating new issues in CAMEL.', input='', output='The significance of having a clear issue description includes:\\n1. Helping maintainers understand the problem or feature request quickly.\\n2. Ensuring that contributors can address the issue effectively.'), AlpacaItem(instruction='What steps should be taken to ensure proper documentation for contributions?', input='', output='To ensure proper documentation for contributions, take the following steps:\\n1. Provide comprehensive docstrings for all classes and methods.\\n2. Update any affected documentation files to reflect changes.'), AlpacaItem(instruction='What is the importance of conducting timely reviews in CAMEL?', input='', output='The importance of conducting timely reviews in CAMEL includes:\\n1. Keeping the project moving forward by addressing contributions quickly.\\n2. Providing feedback that helps contributors improve their code.'), AlpacaItem(instruction='How should contributors approach feedback that they disagree with during code reviews?', input='', output='Contributors should approach feedback they disagree with by:\\n1. Engaging in a discussion with the reviewer to understand their perspective.\\n2. Providing rationale for their viewpoint while remaining open to compromise.'), AlpacaItem(instruction='What are the recommended practices for maintaining code quality during contributions?', input='', output=\"Recommended practices for maintaining code quality include:\\n1. Following the project's style guidelines and using linters.\\n2. Writing unit tests to ensure functionality and prevent regressions.\"), AlpacaItem(instruction='What is the role of the `pre-commit` hook in maintaining code quality?', input='', output='The role of the `pre-commit` hook in maintaining code quality is to:\\n1. Automatically format and lint code before it is committed.\\n2. Help prevent errors and maintain a consistent code style.'), AlpacaItem(instruction='Describe the process for sprint planning in CAMEL.', input='', output='The process for sprint planning in CAMEL involves:\\n1. Conducting a biweekly meeting to define what can be delivered in the sprint.\\n2. Developers selecting items from the backlog to work on during the sprint.'), AlpacaItem(instruction='What should be included in a pull request description for CAMEL?', input='', output='A pull request description for CAMEL should include:\\n1. A clear title and a summary of the changes made.\\n2. References to any related issues and relevant tags.'), AlpacaItem(instruction='How can contributors improve their chances of having their pull requests merged?', input='', output='Contributors can improve their chances of having their pull requests merged by:\\n1. Ensuring their code passes all tests and checks.\\n2. Addressing all feedback from reviewers promptly and effectively.'), AlpacaItem(instruction='What guidelines should contributors follow when adding new features to CAMEL?', input='', output='Contributors should follow these guidelines when adding new features:\\n1. Include unit tests for the new functionality in the `test` directory.\\n2. Update documentation and examples to reflect the new feature.'), AlpacaItem(instruction='What is the purpose of the CAMEL developer meetings?', input='', output='The purpose of CAMEL developer meetings is to:\\n1. Discuss ongoing development and planning for upcoming sprints.\\n2. Provide a platform for team members to share updates and challenges.'), AlpacaItem(instruction='What should contributors do if they encounter issues during setup?', input='', output='If contributors encounter issues during setup, they should:\\n1. Reach out to a maintainer for support.\\n2. Review the documentation for troubleshooting tips.'), AlpacaItem(instruction='Explain the importance of clear and concise explanations in cookbook entries.', input='', output='Clear and concise explanations in cookbook entries are important because:\\n1. They help users understand the code and its purpose quickly.\\n2. They make the content more accessible to users of varying skill levels.'), AlpacaItem(instruction='What is the role of the `test` directory in CAMEL?', input='', output='The role of the `test` directory in CAMEL is to:\\n1. Contain unit tests that validate the functionality of the code.\\n2. Ensure that changes do not introduce regressions or bugs.'), AlpacaItem(instruction='What should contributors keep in mind when using Google Colab for cookbook writing?', input='', output='When using Google Colab for cookbook writing, contributors should keep in mind:\\n1. The importance of using the provided template for consistency.\\n2. The requirement to verify that LLM-generated responses are correct.'), AlpacaItem(instruction='What are some common pitfalls to avoid during code reviews in CAMEL?', input='', output='Common pitfalls to avoid during code reviews in CAMEL include:\\n1. Ignoring feedback from reviewers.\\n2. Submitting large pull requests without breaking them into manageable pieces.'), AlpacaItem(instruction='How does CAMEL define success for a sprint?', input='', output='CAMEL defines success for a sprint by:\\n1. Delivering features that meet the sprint goal and stakeholder expectations.\\n2. Identifying areas for improvement based on feedback received during the review.'), AlpacaItem(instruction='What is the purpose of the `coverage` tool in CAMEL?', input='', output='The purpose of the `coverage` tool in CAMEL is to:\\n1. Measure the extent to which unit tests cover the codebase.\\n2. Help identify areas of the code that may need more testing.'), AlpacaItem(instruction='How should contributors document changes made to existing features?', input='', output='Contributors should document changes made to existing features by:\\n1. Updating relevant documentation files to reflect the modifications.\\n2. Ensuring that any affected examples or tests are also revised accordingly.'), AlpacaItem(instruction=\"What is the significance of the `Common Actions` section in CAMEL's documentation?\", input='', output=\"The significance of the `Common Actions` section in CAMEL's documentation is to:\\n1. Provide contributors with quick reference steps for routine tasks.\\n2. Streamline the development process by highlighting essential commands.\"), AlpacaItem(instruction='What practices should be followed for effective sprint reviews?', input='', output='Effective sprint reviews should follow these practices:\\n1. Collect feedback from stakeholders on delivered features.\\n2. Discuss areas of improvement and lessons learned during the sprint.'), AlpacaItem(instruction=\"How can contributors ensure their changes align with CAMEL's coding standards?\", input='', output=\"Contributors can ensure their changes align with CAMEL's coding standards by:\\n1. Reviewing the project's style guidelines before submitting code.\\n2. Using linters and formatters to check their code before commits.\"), AlpacaItem(instruction='What should be included in the `Args` section of a docstring?', input='', output='The `Args` section of a docstring should include:\\n1. Parameter names matching the function signature.\\n2. Types of the parameters and brief descriptions of their roles.'), AlpacaItem(instruction='What are the benefits of having a structured workflow for issue creation in CAMEL?', input='', output='The benefits of having a structured workflow for issue creation include:\\n1. Improved organization and clarity when addressing bugs or feature requests.\\n2. Enhanced collaboration among contributors by clearly defining responsibilities.'), AlpacaItem(instruction='How does CAMEL handle contributions from community members?', input='', output='CAMEL handles contributions from community members by:\\n1. Encouraging the Fork-and-Pull-Request workflow for submitting changes.\\n2. Providing clear guidelines for contributing to ensure high-quality submissions.'), AlpacaItem(instruction='What is the purpose of documenting code changes in pull requests?', input='', output='The purpose of documenting code changes in pull requests is to:\\n1. Provide reviewers with context about the modifications made.\\n2. Facilitate easier and more efficient code reviews.'), AlpacaItem(instruction='Explain the significance of using a template for cookbook writing in CAMEL.', input='', output='The significance of using a template for cookbook writing in CAMEL is to:\\n1. Ensure consistency in style and structure across all entries.\\n2. Make it easier for users to follow along and understand the content.'), AlpacaItem(instruction='What should contributors do if they notice outdated issues on GitHub?', input='', output='If contributors notice outdated issues on GitHub, they should:\\n1. Notify maintainers about the outdated status for review.\\n2. Consider updating the issue based on the current project context.'), AlpacaItem(instruction='How does CAMEL ensure that contributions are of high quality?', input='', output='CAMEL ensures high-quality contributions by:\\n1. Implementing a thorough code review process before merging changes.\\n2. Requiring documentation and tests for all new features or bug fixes.'), AlpacaItem(instruction='What is the role of feedback in the CAMEL contribution process?', input='', output=\"The role of feedback in the CAMEL contribution process is to:\\n1. Help contributors improve their code and understanding of best practices.\\n2. Ensure that the final product meets the project's quality standards.\"), AlpacaItem(instruction='How can contributors verify that their code passes all tests before submitting?', input='', output='Contributors can verify that their code passes all tests by:\\n1. Running `pytest .` to execute all tests before submission.\\n2. Ensuring that all tests pass without errors.'), AlpacaItem(instruction='What should be done if a contributor wants to make a significant change to CAMEL?', input='', output='If a contributor wants to make a significant change to CAMEL, they should:\\n1. Discuss the proposed change with maintainers for guidance and approval.\\n2. Outline the change clearly in a new issue before proceeding.'), AlpacaItem(instruction='What is the importance of maintaining a clean and readable codebase in CAMEL?', input='', output='Maintaining a clean and readable codebase in CAMEL is important because:\\n1. It facilitates easier collaboration among contributors.\\n2. It helps prevent bugs and makes the code easier to maintain long-term.'), AlpacaItem(instruction='What are the expectations for documentation updates when features are added or modified?', input='', output='Expectations for documentation updates include:\\n1. Ensuring that all relevant documentation reflects the changes made.\\n2. Providing clear explanations of new features or modifications for users.'), AlpacaItem(instruction='How can contributors communicate effectively with the CAMEL team?', input='', output='Contributors can communicate effectively with the CAMEL team by:\\n1. Utilizing Discord for real-time discussions and questions.\\n2. Being clear and concise in their messages to facilitate understanding.'), AlpacaItem(instruction='What is the purpose of the CAMEL community?', input='', output='The purpose of the CAMEL community is to:\\n1. Foster collaboration among contributors.\\n2. Provide support and resources for developers interested in the project.'), AlpacaItem(instruction='Describe the significance of the `Common Actions` section in the documentation.', input='', output='The significance of the `Common Actions` section in the documentation is to:\\n1. Provide contributors with quick access to essential commands and procedures.\\n2. Streamline common tasks to enhance productivity and efficiency.'), AlpacaItem(instruction='How does CAMEL handle contributions from new developers?', input='', output='CAMEL handles contributions from new developers by:\\n1. Providing clear guidelines and documentation to help them navigate the project.\\n2. Encouraging engagement through community channels for support.'), AlpacaItem(instruction='What principles should be followed when writing tests for new features in CAMEL?', input='', output='Principles to follow when writing tests for new features in CAMEL include:\\n1. Covering all new functionality with appropriate unit tests in the `test` directory.\\n2. Ensuring that tests are clear, maintainable, and provide good coverage for edge cases.'), AlpacaItem(instruction='What is the purpose of the CAMEL project?', input='', output='The purpose of the CAMEL project is to provide an open-source initiative focused on rapidly evolving and open-ended fields, welcoming contributions of all kinds to enhance its capabilities.'), AlpacaItem(instruction='How can contributors communicate efficiently within the CAMEL community?', input='', output=\"Contributors can communicate efficiently within the CAMEL community by joining the project's Discord server, which facilitates discussions and collaboration.\"), AlpacaItem(instruction='What are the steps for scheduling an introduction call with CAMEL?', input='', output='To schedule an introduction call with CAMEL, contributors can use the provided Calendly links for English or Chinese speakers, depending on their preference.'), AlpacaItem(instruction='What is the Fork-and-Pull-Request workflow in CAMEL?', input='', output='The Fork-and-Pull-Request workflow involves contributors forking the repository, making changes, and then submitting a pull request for review and integration into the main project.'), AlpacaItem(instruction='What is the significance of the CAMEL cookbook?', input='', output=\"The CAMEL cookbook is an essential resource for users, providing practical examples and guidelines for utilizing the project's features effectively.\"), AlpacaItem(instruction='How should contributors ensure the correctness of their cookbook entries?', input='', output='Contributors should verify that LLM-generated responses in their cookbook entries are correct by executing the code and ensuring the results are accurate.'), AlpacaItem(instruction='What are the key principles to follow when writing cookbook entries?', input='', output='Key principles for writing cookbook entries include maintaining high quality, ensuring reproducibility, providing clear explanations, and making the content accessible to a wide audience.'), AlpacaItem(instruction='What is the process for submitting a cookbook to CAMEL?', input='', output='To submit a cookbook, contributors should download the finalized Colab notebook as a .ipynb file, create a pull request including the file, and provide necessary documentation for integration.'), AlpacaItem(instruction='What should contributors do before their pull request can be merged?', input='', output='Before a pull request can be merged, it must pass formatting, linting, and testing checks, and the contributor should mention any related issues and tag relevant maintainers.'), AlpacaItem(instruction='How can contributors improve their code reviews in CAMEL?', input='', output='Contributors can improve their code reviews by ensuring the code is clean, readable, and well-documented, and by addressing all feedback provided by reviewers.'), AlpacaItem(instruction='What is the purpose of the Code Review Checklist in CAMEL?', input='', output='The Code Review Checklist helps maintain code quality by ensuring that all contributions meet functionality, code quality, design, and documentation standards.'), AlpacaItem(instruction='What are the responsibilities of a reviewer in CAMEL?', input='', output=\"Reviewers are responsible for conducting timely reviews, providing constructive feedback, collaborating with contributors to address issues, and approving code that meets the project's standards.\"), AlpacaItem(instruction='How should contributors document their parameters in code?', input='', output=\"Contributors should document parameters in the 'Args' section of their docstrings, including the parameter name, type, description, and default value if applicable.\"), AlpacaItem(instruction='What is the guideline for writing docstrings in CAMEL?', input='', output=\"The guideline for writing docstrings includes using triple-quoted strings, providing a brief class or method description, and documenting parameters clearly in the 'Args' section.\"), AlpacaItem(instruction='What are the best practices for logging in CAMEL?', input='', output=\"Best practices for logging in CAMEL include using the 'logger' instead of 'print', ensuring consistent and configurable logging for better tracking of events.\"), AlpacaItem(instruction='What is the significance of issue management in CAMEL?', input='', output='Issue management in CAMEL is significant for tracking bugs, improvements, and feature requests, helping the team stay organized and focused on project goals.'), AlpacaItem(instruction='How should contributors engage with issues on GitHub for CAMEL?', input='', output='Contributors should assign issues to themselves when working on them, create focused issues, and link related issues instead of merging them into one.'), AlpacaItem(instruction='What is the purpose of sprint planning in CAMEL?', input='', output='The purpose of sprint planning in CAMEL is to define what can be delivered in the sprint and how the team will achieve the goals set for that period.'), AlpacaItem(instruction='How long is a typical sprint in CAMEL?', input='', output='A typical sprint in CAMEL lasts two weeks for development and one week for review.'), AlpacaItem(instruction='What should contributors include in their pull requests?', input='', output='Contributors should include a proper title, link related issues, update reviewers and assignees, and provide any necessary documentation when creating a pull request.'), AlpacaItem(instruction='How can contributors ensure that their contributions are accessible?', input='', output='Contributors can ensure their contributions are accessible by providing clear explanations, defining technical terms, and writing documentation that caters to a wide range of users.'), AlpacaItem(instruction='What are the steps to build documentation locally in CAMEL?', input='', output=\"To build documentation locally, contributors should navigate to the 'docs' directory and run the command 'make html'.\"), AlpacaItem(instruction='What does the coverage report indicate in CAMEL?', input='', output='The coverage report indicates the extent to which unit tests cover the code, helping identify robust and less robust areas of the codebase.'), AlpacaItem(instruction='How should contributors handle dependencies in CAMEL?', input='', output=\"Contributors should run 'poetry lock' to synchronize dependencies with the lock file whenever they add, update, or delete any dependencies in 'pyproject.toml'.\"), AlpacaItem(instruction='What is the role of unit tests in the CAMEL project?', input='', output='The role of unit tests in the CAMEL project is to ensure that new features work as intended and to catch potential bugs early in the development process.'), AlpacaItem(instruction='What are the key actions to take before pushing code in CAMEL?', input='', output=\"Before pushing code, contributors should run camel's pre-commit hooks to ensure that the code is auto-formatted and linted.\"), AlpacaItem(instruction='What is the importance of using Google Colab for cookbook contributions?', input='', output='Google Colab is important for cookbook contributions as it allows contributors to write interactive code and explanations side-by-side, enhancing the practical value of the cookbook.'), AlpacaItem(instruction='What should contributors do if they encounter difficulties during setup?', input='', output='If contributors encounter difficulties during setup, they should reach out to a maintainer for assistance to ensure a smooth experience.'), AlpacaItem(instruction='How can contributors effectively review cookbooks in CAMEL?', input='', output='Contributors can effectively review cookbooks by checking for accuracy, clarity, structure, and adherence to the provided template guidelines.'), AlpacaItem(instruction='What should be included in a pull request for documentation updates?', input='', output='A pull request for documentation updates should include a clear title, details of the changes made, and any necessary references to integrate the updates into the main documentation.'), AlpacaItem(instruction='What is the process for generating a coverage report in CAMEL?', input='', output=\"To generate a coverage report, contributors should run 'coverage run --source=. -m pytest .' followed by 'coverage html' to produce an HTML report.\"), AlpacaItem(instruction='How can contributors maintain high-quality cookbook entries?', input='', output='Contributors can maintain high-quality cookbook entries by ensuring correctness, providing clear explanations, and following the established template for consistency.'), AlpacaItem(instruction='What is the goal of the CAMEL community?', input='', output='The goal of the CAMEL community is to foster collaboration, support contributors, and continuously improve the project through collective efforts.'), AlpacaItem(instruction='What are the guidelines for submitting bug fixes in CAMEL?', input='', output=\"When submitting bug fixes in CAMEL, contributors should include relevant unit tests, update documentation if affected, and ensure the code adheres to the project's coding standards.\"), AlpacaItem(instruction='How can contributors ensure their code is maintainable?', input='', output='Contributors can ensure their code is maintainable by structuring it logically, avoiding unnecessary duplication, and following established design patterns.'), AlpacaItem(instruction='What is the significance of the CAMEL license?', input='', output='The CAMEL license, which is Apache 2.0, ensures that contributed code is open-source and can be used, modified, and distributed under specified terms.'), AlpacaItem(instruction='What is the process for giving credit for contributions in CAMEL?', input='', output='The process for giving credit involves recognizing contributors on Twitter if they are comfortable with it, ensuring they receive acknowledgment for their valuable contributions.'), AlpacaItem(instruction='How should contributors handle large pull requests?', input='', output='Contributors should avoid submitting large pull requests by breaking down changes into smaller, manageable pieces to facilitate easier review.'), AlpacaItem(instruction='What should contributors do if they disagree with feedback on their pull request?', input='', output='If contributors disagree with feedback on their pull request, they should discuss the concerns with the reviewer instead of ignoring the feedback.'), AlpacaItem(instruction='What is the goal of sprint reviews in CAMEL?', input='', output='The goal of sprint reviews in CAMEL is to allow stakeholders to review work completed during the sprint and provide feedback on delivered features.'), AlpacaItem(instruction='How can contributors improve their testing coverage in CAMEL?', input='', output='Contributors can improve their testing coverage by writing comprehensive unit tests for new features and ensuring that existing tests are updated as needed.'), AlpacaItem(instruction='What are the best practices for using the GitHub issues page in CAMEL?', input='', output='Best practices for using the GitHub issues page include keeping issues focused on specific topics, assigning them to oneself when working on them, and updating the status regularly.'), AlpacaItem(instruction='What should contributors do to prepare for a developer meeting in CAMEL?', input='', output='To prepare for a developer meeting, contributors should review the agenda, gather updates on their work, and be ready to discuss any challenges or questions they may have.'), AlpacaItem(instruction='How can contributors ensure their code is secure?', input='', output='Contributors can ensure their code is secure by checking for vulnerabilities, following best practices, and conducting thorough code reviews.'), AlpacaItem(instruction='What is the role of feedback in the CAMEL development process?', input='', output='Feedback plays a crucial role in the CAMEL development process by helping contributors improve their code, ensuring adherence to standards, and fostering collaboration among team members.'), AlpacaItem(instruction='What is the purpose of the CAMEL development environment setup?', input='', output='The purpose of the CAMEL development environment setup is to provide contributors with all necessary tools and dependencies to develop and test features effectively.'), AlpacaItem(instruction='How can contributors maintain clear communication during the review process?', input='', output='Contributors can maintain clear communication during the review process by responding promptly to reviewer comments and engaging in discussions to clarify any misunderstandings.'), AlpacaItem(instruction='What is the importance of following coding standards in CAMEL?', input='', output='Following coding standards in CAMEL is important for maintaining code quality, ensuring consistency, and making the codebase easier to read and maintain.'), AlpacaItem(instruction='How should contributors approach documentation updates?', input='', output='Contributors should approach documentation updates by clearly identifying what needs to be changed, ensuring accuracy, and integrating updates into the main documentation seamlessly.'), AlpacaItem(instruction='What should contributors do to make their contributions more effective?', input='', output='Contributors can make their contributions more effective by collaborating with others, seeking feedback, and continuously improving their skills and understanding of the project.'), AlpacaItem(instruction='What should contributors do if they encounter challenges during the setup process?', input='', output='If contributors encounter challenges during the setup process, they should reach out to a maintainer for assistance to ensure a smooth experience.'), AlpacaItem(instruction='Describe the guidelines for contributing to the CAMEL codebase.', input='', output='Contributors should follow the Fork-and-Pull-Request workflow and ensure their pull requests pass formatting, linting, and testing checks before merging.'), AlpacaItem(instruction='What is the purpose of the CAMEL project?', input='', output='The purpose of the CAMEL project is to provide an open-source initiative in a rapidly evolving field, welcoming contributions for new features, enhancements, and bug fixes.'), AlpacaItem(instruction='How can contributors ensure their code is well-documented?', input='', output='Contributors can ensure their code is well-documented by providing comprehensive docstrings for all classes and methods, following the established guidelines.'), AlpacaItem(instruction='What is the significance of the CAMEL community?', input='', output='The CAMEL community is significant as it fosters collaboration, knowledge sharing, and support among contributors and users of the project.'), AlpacaItem(instruction='How should contributors handle issues that become outdated?', input='', output='Contributors should notify maintainers if they come across outdated issues on the GitHub Issues page, so they can be addressed promptly.'), AlpacaItem(instruction=\"What is the proper way to document parameters in a function's docstring?\", input='', output=\"Parameters should be documented in an 'Args:' section, including the parameter name, type, description, and default value if applicable.\"), AlpacaItem(instruction='What are the steps for submitting a cookbook in CAMEL?', input='', output='To submit a cookbook, contributors must write it in Google Colab, review it for accuracy, download it as a .ipynb file, and create a pull request to add it to the docs folder.'), AlpacaItem(instruction='What is the role of the `logger` in CAMEL?', input='', output='The role of the `logger` is to provide a consistent and configurable logging mechanism, replacing the use of print statements for better output management.'), AlpacaItem(instruction='How can contributors contribute to the CAMEL cookbook?', input='', output='Contributors can contribute to the CAMEL cookbook by writing, reviewing, and submitting entries that follow the provided template and guidelines.'), AlpacaItem(instruction='What should contributors do to maintain code quality during reviews?', input='', output='Contributors should ensure their code is clean, readable, adheres to style guidelines, and includes sufficient test coverage.'), AlpacaItem(instruction='What is the process for conducting code reviews in CAMEL?', input='', output='The process for conducting code reviews involves checking functionality, readability, consistency, and compliance with coding standards, followed by constructive feedback.'), AlpacaItem(instruction='What is the significance of using Google Colab for the CAMEL cookbook?', input='', output='Using Google Colab allows contributors to write interactive code and explanations side-by-side, providing a practical and hands-on experience for users.'), AlpacaItem(instruction='How can contributors ensure reproducibility in their cookbook entries?', input='', output='Contributors can ensure reproducibility by providing accurate code that produces consistent results when executed by users.'), AlpacaItem(instruction='What are the common pitfalls to avoid when submitting a pull request?', input='', output='Common pitfalls to avoid include submitting overly large PRs, ignoring reviewer feedback, and rushing through the review process.'), AlpacaItem(instruction='How do contributors maintain high standards in the CAMEL cookbook?', input='', output='Contributors maintain high standards by ensuring high-quality entries, accurate code, thorough testing, and clear explanations.'), AlpacaItem(instruction='What is the importance of the `pre-commit` hook in CAMEL?', input='', output='The `pre-commit` hook is important as it automatically formats and lints code, ensuring a consistent code style before commits.'), AlpacaItem(instruction='What steps should be taken to build documentation locally?', input='', output=\"To build documentation locally, navigate to the 'docs' directory and run 'make html' to generate the documentation.\"), AlpacaItem(instruction='What principles should contributors follow when writing docstrings?', input='', output='Contributors should use triple-quoted strings, provide a brief description, document parameters clearly, and ensure clarity and consistency.'), AlpacaItem(instruction='How can contributors engage with the CAMEL community?', input='', output='Contributors can engage with the CAMEL community by joining communication channels such as Discord, WeChat, and Slack.'), AlpacaItem(instruction='What is the recommended approach for submitting issues in CAMEL?', input='', output='The recommended approach is to create a focused issue on GitHub, assign it to oneself, and provide a clear title and description.'), AlpacaItem(instruction='How can contributors improve their chances of having their code merged?', input='', output='Contributors can improve their chances of having their code merged by ensuring it passes all tests, addressing feedback promptly, and following contribution guidelines.'), AlpacaItem(instruction='What should be included in a pull request description?', input='', output='A pull request description should include a summary of changes, mention related issues, and detail any relevant context for the reviewers.'), AlpacaItem(instruction='How do contributors manage dependencies in CAMEL?', input='', output=\"Contributors manage dependencies by updating the `pyproject.toml` file and running 'poetry lock' to synchronize with the lock file.\"), AlpacaItem(instruction='What is the purpose of the CAMEL sprint planning process?', input='', output='The purpose of the CAMEL sprint planning process is to define deliverables for the sprint and outline how they will be achieved.'), AlpacaItem(instruction='How can contributors ensure accessibility in their cookbook entries?', input='', output='Contributors can ensure accessibility by providing context, defining technical terms, and making content understandable for all user levels.'), AlpacaItem(instruction='What are the benefits of conducting regular code reviews?', input='', output='Regular code reviews help maintain code quality, encourage knowledge sharing, catch bugs early, and ensure consistency in the codebase.'), AlpacaItem(instruction='What is the role of documentation in the CAMEL project?', input='', output=\"Documentation plays a crucial role in providing guidance, explaining code functionality, and ensuring users can effectively utilize the project's features.\"), AlpacaItem(instruction='How should contributors approach writing tests?', input='', output='Contributors should write tests that cover functionality, ensure edge cases are handled, and validate that the code performs as expected.'), AlpacaItem(instruction='What is the significance of using a consistent coding style?', input='', output='Using a consistent coding style enhances readability, maintainability, and collaboration within the development team.'), AlpacaItem(instruction='What should contributors do if they want to add a new feature?', input='', output='Contributors should outline the feature, discuss it with maintainers, and follow the contribution guidelines when implementing it.'), AlpacaItem(instruction='How can contributors validate LLM-generated responses in their cookbooks?', input='', output='Contributors can validate LLM-generated responses by executing the code and ensuring the results match expected outcomes.'), AlpacaItem(instruction='What are the expectations for contributors regarding testing code?', input='', output='Contributors are expected to write unit tests for their code, ensuring sufficient coverage and passing all tests before submitting a pull request.'), AlpacaItem(instruction='How should contributors handle feedback from code reviews?', input='', output='Contributors should address all feedback constructively, making necessary changes and engaging in discussions to clarify any concerns.'), AlpacaItem(instruction='What is the importance of clearly defined roles in the code review process?', input='', output='Clearly defined roles in the code review process help maintain accountability, streamline reviews, and ensure thorough evaluations of contributions.'), AlpacaItem(instruction='How can contributors contribute to documentation updates?', input='', output='Contributors can contribute to documentation updates by reviewing existing content, suggesting improvements, and adding new information as needed.'), AlpacaItem(instruction='What steps should be taken when creating a new issue in CAMEL?', input='', output='When creating a new issue, contributors should provide a clear title, detailed description, assign it to themselves, and categorize it appropriately.'), AlpacaItem(instruction=\"How can contributors help maintain the project's overall quality?\", input='', output=\"Contributors can help maintain the project's overall quality by adhering to guidelines, participating in reviews, and writing tests.\"), AlpacaItem(instruction='What are the key elements of effective communication in the CAMEL community?', input='', output='Key elements of effective communication include clarity, responsiveness, constructive feedback, and collaboration across channels.'), AlpacaItem(instruction='How can contributors ensure that their code is modular?', input='', output='Contributors can ensure their code is modular by breaking it into self-contained components that can be easily tested and reused.'), AlpacaItem(instruction='What is the impact of high-quality documentation on user engagement?', input='', output=\"High-quality documentation positively impacts user engagement by making it easier for users to understand and utilize the project's features effectively.\"), AlpacaItem(instruction='What is the process for integrating a cookbook entry into the main documentation?', input='', output='The process involves completing the entry in Colab, reviewing it, downloading it as a .ipynb file, and submitting it via a pull request.'), AlpacaItem(instruction='How can contributors effectively participate in developer meetings?', input='', output='Contributors can effectively participate in developer meetings by preparing updates, discussing progress, and providing feedback on ongoing work.'), AlpacaItem(instruction='What strategies can contributors use to improve their coding skills?', input='', output='Contributors can improve their coding skills by engaging in code reviews, studying best practices, and contributing to various aspects of the project.'), AlpacaItem(instruction='What is the importance of providing feedback during the review process?', input='', output='Providing feedback during the review process is important for fostering learning, improving code quality, and ensuring alignment with project goals.'), AlpacaItem(instruction='How should contributors manage their time during a sprint?', input='', output='Contributors should prioritize tasks, set clear goals, and regularly assess their progress to manage their time effectively during a sprint.'), AlpacaItem(instruction='What are the best practices for writing clear commit messages?', input='', output='Best practices for writing clear commit messages include being concise, summarizing changes, and using imperative language.'), AlpacaItem(instruction='How can contributors help onboard new members to the CAMEL community?', input='', output='Contributors can help onboard new members by providing guidance, sharing resources, and encouraging participation in discussions and meetings.'), AlpacaItem(instruction='What role does versioning play in the CAMEL project?', input='', output='Versioning helps manage changes in the project, communicate updates to users, and maintain compatibility between different releases.'), AlpacaItem(instruction='What is the purpose of the CAMEL project license?', input='', output='The purpose of the CAMEL project license is to define the terms under which the source code can be used, modified, and distributed.'), AlpacaItem(instruction='What steps are involved in the process of contributing to the CAMEL project?', input='', output='The steps involved in contributing to the CAMEL project include:\\n1. Joining the community via Discord for communication.\\n2. Following the Fork-and-Pull-Request workflow for community contributors or the Checkout-and-Pull-Request workflow for CAMEL members.\\n3. Mentioning any related issues and tagging relevant maintainers in your pull request.\\n4. Ensuring your pull request passes formatting, linting, and testing checks before it can be merged.'), AlpacaItem(instruction='Explain the guidelines for writing docstrings in CAMEL.', input='', output='The guidelines for writing docstrings in CAMEL include:\\n1. Use raw triple-quoted strings (r\"\"\") to avoid issues with special characters.\\n2. Provide a brief description of the class or method at the beginning, keeping lines under 79 characters.\\n3. Document parameters in an Args section with the parameter name, type, description, and default value.'), AlpacaItem(instruction='What are the primary communication channels available for CAMEL contributors?', input='', output='The primary communication channels available for CAMEL contributors include:\\n1. Discord for real-time communication.\\n2. WeChat for Chinese-speaking contributors.\\n3. Slack for collaboration and updates.'), AlpacaItem(instruction='Describe the process for submitting a cookbook contribution in CAMEL.', input='', output='The process for submitting a cookbook contribution in CAMEL includes:\\n1. Using the provided Google Colab template to write the cookbook entry.\\n2. Ensuring the content is correct and interactive, with clear explanations.\\n3. Reviewing the draft in Colab and addressing comments from reviewers.\\n4. Downloading the finalized notebook as a .ipynb file and creating a pull request to add it to the docs folder.'), AlpacaItem(instruction='What is the significance of following the Fork-and-Pull-Request workflow?', input='', output='The significance of following the Fork-and-Pull-Request workflow is that it allows community contributors to make changes to the codebase without direct access. This ensures that contributions can be reviewed and discussed before being integrated into the main project.'), AlpacaItem(instruction='What should contributors keep in mind when fixing a bug in CAMEL?', input='', output='When fixing a bug in CAMEL, contributors should:\\n1. Add a relevant unit test when possible to ensure the bug is addressed.\\n2. Update any affected documentation and example scripts to reflect the changes.'), AlpacaItem(instruction='How does CAMEL define the roles of reviewers during the code review process?', input='', output='In CAMEL, the roles of reviewers during the code review process include:\\n1. Ensuring code quality by checking functionality, readability, and compliance with coding standards.\\n2. Providing constructive feedback to contributors.\\n3. Approving changes only when the code meets all necessary criteria.'), AlpacaItem(instruction='What are the key principles to follow when contributing to the CAMEL cookbook?', input='', output='Key principles to follow when contributing to the CAMEL cookbook include:\\n1. Maintaining high quality by ensuring correct code and well-written explanations.\\n2. Ensuring reproducibility, so users can achieve the same results by following the cookbook steps.\\n3. Making the content accessible to a wide range of users.'), AlpacaItem(instruction='What is the purpose of the Code Review Checklist in CAMEL?', input='', output='The purpose of the Code Review Checklist in CAMEL is to ensure that contributions meet quality standards. It covers aspects like correctness, testing, readability, maintainability, and adherence to design patterns.'), AlpacaItem(instruction='Describe how to build documentation locally for CAMEL.', input='', output='To build documentation locally for CAMEL, follow these steps:\\n1. Navigate to the docs directory using the command `cd docs`.\\n2. Run the command `make html` to generate the HTML documentation.'), AlpacaItem(instruction='What actions should be taken when creating a new issue in CAMEL?', input='', output='When creating a new issue in CAMEL, you should:\\n1. Focus on a specific bug, improvement, or feature.\\n2. Provide a proper title and fill in the required information.\\n3. Assign the issue to yourself and update relevant labels and milestones.'), AlpacaItem(instruction='How can contributors ensure their code is properly formatted before submission?', input='', output='Contributors can ensure their code is properly formatted before submission by running `pre-commit run --all-files` to apply auto-formatting and linting checks.'), AlpacaItem(instruction='What should be included in a pull request description?', input='', output='A pull request description should include:\\n1. A clear title summarizing the changes.\\n2. A detailed description of what was changed and why.\\n3. Links to any related issues or discussions.'), AlpacaItem(instruction='What is the role of the `logger` in CAMEL instead of using `print` statements?', input='', output='The role of the `logger` in CAMEL is to provide a consistent, configurable, and professional logging system, which is preferable to using `print` statements. This allows for better control over logging levels and outputs.'), AlpacaItem(instruction='What are the recommended practices for conducting code reviews in CAMEL?', input='', output='Recommended practices for conducting code reviews in CAMEL include:\\n1. Reviewing code promptly to keep the project moving.\\n2. Providing clear and constructive feedback.\\n3. Collaborating with contributors to address issues.'), AlpacaItem(instruction='How does CAMEL handle dependency management?', input='', output='CAMEL handles dependency management using Poetry. Contributors should update the `pyproject.toml` file and run `poetry lock` to synchronize dependencies with the lock file.'), AlpacaItem(instruction='What are the expected outcomes of a successful sprint review in CAMEL?', input='', output='The expected outcomes of a successful sprint review in CAMEL include:\\n1. Feedback from stakeholders on delivered features.\\n2. Identification of areas for improvement based on the review.'), AlpacaItem(instruction='What guidelines should contributors follow when updating documentation?', input='', output='Contributors should follow these guidelines when updating documentation:\\n1. Ensure that all classes and methods are well-documented.\\n2. Verify that documentation is accurate and reflects the latest changes.'), AlpacaItem(instruction='What is the significance of ensuring reproducibility in cookbook contributions?', input='', output='Ensuring reproducibility in cookbook contributions is significant because it allows users to achieve the same results by running the provided code, which enhances the reliability and usability of the cookbook.'), AlpacaItem(instruction='Describe the process for conducting a sprint planning meeting in CAMEL.', input='', output='The process for conducting a sprint planning meeting in CAMEL includes:\\n1. The founder highlights the sprint goal and key points.\\n2. Developers select items from the backlog to work on during the sprint.'), AlpacaItem(instruction='What should contributors do if they encounter challenges during the setup process?', input='', output='If contributors encounter challenges during the setup process, they should reach out to a maintainer for assistance to ensure a smooth experience.'), AlpacaItem(instruction='Explain the purpose of the `docs` label in CAMEL pull requests.', input='', output='The purpose of the `docs` label in CAMEL pull requests is to categorize changes that involve updates or improvements to documentation, ensuring clarity and organization in the review process.'), AlpacaItem(instruction='What are the common pitfalls to avoid during code reviews?', input='', output='Common pitfalls to avoid during code reviews include:\\n1. Submitting large pull requests that are difficult to review.\\n2. Ignoring feedback from reviewers.\\n3. Rushing through the review process.'), AlpacaItem(instruction='What is the process for reviewing contributions to the CAMEL cookbook?', input='', output='The process for reviewing contributions to the CAMEL cookbook involves:\\n1. Reviewing drafts in Google Colab and leaving comments.\\n2. Ensuring accuracy and clarity of code and explanations.\\n3. Confirming that the flow of the cookbook is logical.'), AlpacaItem(instruction='How should contributors document parameters in their code?', input='', output='Contributors should document parameters in their code using an `Args` section, specifying the parameter name, type, description, and default value, while maintaining a 79-character line limit.'), AlpacaItem(instruction='What are the steps to run unit tests in CAMEL?', input='', output='To run unit tests in CAMEL, follow these steps:\\n1. Ensure you have the necessary API keys configured in a .env file.\\n2. Use the command `pytest .` to run all tests.'), AlpacaItem(instruction='What are the guidelines for contributing to the code in CAMEL?', input='', output='The guidelines for contributing to the code in CAMEL include:\\n1. Following the Fork-and-Pull-Request workflow.\\n2. Mentioning related issues and tagging relevant maintainers.\\n3. Ensuring code passes formatting, linting, and testing checks.'), AlpacaItem(instruction='What tools does CAMEL use for code linting and formatting?', input='', output=\"CAMEL uses Ruff for code linting and formatting, ensuring that the code adheres to the project's style guidelines.\"), AlpacaItem(instruction='Explain how to ensure high-quality contributions to the CAMEL project.', input='', output='To ensure high-quality contributions to the CAMEL project, contributors should maintain code correctness, provide thorough documentation, write unit tests, and ensure code is well-structured and readable.'), AlpacaItem(instruction='What should contributors do after their pull request is approved?', input='', output='After their pull request is approved, contributors should ensure it is merged into the main branch, which is typically done by a maintainer or an authorized contributor.'), AlpacaItem(instruction='What is the role of the `chore` label in CAMEL?', input='', output='The role of the `chore` label in CAMEL is to categorize pull requests that involve routine maintenance tasks, such as updating dependencies or improving build processes.'), AlpacaItem(instruction='What practices should be followed for effective sprint planning?', input='', output='Effective sprint planning practices include:\\n1. Clearly defining the sprint goal and key objectives.\\n2. Allowing developers to select tasks from the backlog based on priority and capacity.'), AlpacaItem(instruction='How can contributors ensure their contributions are recognized?', input='', output='Contributors can ensure their contributions are recognized by providing their Twitter handle in pull requests to receive credit when their work is included in a release.'), AlpacaItem(instruction='What does the CAMEL community emphasize about contributions?', input='', output='The CAMEL community emphasizes inclusivity and welcomes contributions of all kinds, from bug fixes to new features, to enhance the project.'), AlpacaItem(instruction='What is the importance of having a structured workflow for managing project items in CAMEL?', input='', output='The importance of having a structured workflow for managing project items in CAMEL is to ensure efficiency, clarity, and organization during development, making it easier to track progress and manage contributions.'), AlpacaItem(instruction='What are the key actions to take when updating dependencies in CAMEL?', input='', output='Key actions to take when updating dependencies in CAMEL include modifying the `pyproject.toml` file, running `poetry lock` to synchronize dependencies, and testing the updates to ensure compatibility.'), AlpacaItem(instruction='What type of feedback is expected from reviewers during the code review process?', input='', output='Reviewers are expected to provide clear, constructive feedback that helps contributors improve their code, focusing on functionality, readability, and adherence to coding standards.'), AlpacaItem(instruction='What is the significance of the `fix` label in CAMEL pull requests?', input='', output='The significance of the `fix` label in CAMEL pull requests is to categorize changes that resolve bugs or issues, allowing for easier tracking and prioritization of bug fixes.'), AlpacaItem(instruction='Describe the importance of documentation in the CAMEL project.', input='', output='Documentation is crucial in the CAMEL project as it ensures that users and contributors can understand how to use the software, contribute effectively, and maintain high-quality code.'), AlpacaItem(instruction='What should contributors do if they wish to propose a new feature in CAMEL?', input='', output=\"If contributors wish to propose a new feature in CAMEL, they should create a detailed issue outlining the feature, its benefits, and how it aligns with the project's goals, then discuss it with the community.\"), AlpacaItem(instruction='What is the process for integrating a new cookbook entry into the CAMEL documentation?', input='', output='The process for integrating a new cookbook entry into the CAMEL documentation involves writing the entry in Google Colab, reviewing it with feedback, downloading it as a .ipynb file, and creating a pull request to add it to the docs.'), AlpacaItem(instruction='What are the expectations for clarity in explanations within the CAMEL cookbook?', input='', output='Expectations for clarity in explanations within the CAMEL cookbook include providing straightforward, detailed descriptions of the code, its purpose, and ensuring complex logic is well documented.'), AlpacaItem(instruction='How should contributors handle feedback received during code reviews?', input='', output='Contributors should address all feedback received during code reviews, discussing any disagreements with reviewers to reach a consensus before updating the pull request.'), AlpacaItem(instruction='What practices should be followed to maintain code quality in CAMEL?', input='', output='Practices to maintain code quality in CAMEL include writing unit tests, reviewing code for adherence to style guidelines, and ensuring comprehensive documentation is provided.'), AlpacaItem(instruction='What is the purpose of the `test` label in CAMEL pull requests?', input='', output='The purpose of the `test` label in CAMEL pull requests is to categorize changes that involve adding or updating tests, ensuring that testing is prioritized in the development process.'), AlpacaItem(instruction='What steps should be taken to prepare for a developer meeting in CAMEL?', input='', output='To prepare for a developer meeting in CAMEL, participants should review the agenda, gather updates on their tasks, and be ready to discuss any challenges or feedback regarding ongoing work.'), AlpacaItem(instruction='What is the significance of community engagement for the CAMEL project?', input='', output='Community engagement is significant for the CAMEL project as it fosters collaboration, encourages diverse contributions, and helps maintain a supportive environment for all contributors.'), AlpacaItem(instruction='How can contributors ensure their code is secure before merging?', input='', output='Contributors can ensure their code is secure before merging by conducting thorough reviews for vulnerabilities, following best security practices, and running security-focused tests.'), AlpacaItem(instruction='What are the benefits of using Google Colab for writing cookbooks?', input='', output='The benefits of using Google Colab for writing cookbooks include the ability to run interactive code cells alongside explanations, facilitating a practical, hands-on approach for users.'), AlpacaItem(instruction='What steps should be taken to handle dependencies in CAMEL effectively?', input='', output='To handle dependencies in CAMEL effectively, contributors should regularly update the `pyproject.toml` file, synchronize with `poetry lock`, and test the application to ensure compatibility.'), AlpacaItem(instruction='What are the key benefits of joining the CAMEL community?', input='', output='Joining the CAMEL community provides several key benefits:\\n1. **Collaboration**: Engage with a diverse group of contributors and developers who share knowledge and expertise.\\n2. **Support**: Access to assistance from maintainers and experienced contributors during the development process.\\n3. **Networking**: Opportunities to connect with professionals in the field and enhance your career prospects.'), AlpacaItem(instruction='How can contributors ensure their pull requests are merged efficiently?', input='', output='Contributors can ensure their pull requests are merged efficiently by:\\n1. Following the Fork-and-Pull-Request workflow.\\n2. Ensuring their PR meets all formatting, linting, and testing checks.\\n3. Clearly documenting the purpose of the PR and linking any related issues.'), AlpacaItem(instruction='What are the guidelines for writing effective docstrings in CAMEL?', input='', output='The guidelines for writing effective docstrings in CAMEL include:\\n1. Use triple-quoted strings with `r\"\"\"` to prevent issues with special characters.\\n2. Provide a concise summary of the class or method\\'s purpose.\\n3. Document parameters in an `Args:` section, including type and description.'), AlpacaItem(instruction='What is the importance of code reviews in the CAMEL project?', input='', output='Code reviews in the CAMEL project are important for:\\n1. Maintaining code quality and ensuring clean, readable, and maintainable code.\\n2. Facilitating knowledge sharing among contributors and helping new contributors learn best practices.\\n3. Catching potential bugs and issues before they are merged.'), AlpacaItem(instruction='Explain the process of submitting a cookbook to CAMEL.', input='', output='The process of submitting a cookbook to CAMEL involves:\\n1. Writing the cookbook using the provided template in Google Colab.\\n2. Reviewing the draft in Colab and addressing feedback from reviewers.\\n3. Downloading the finalized notebook as a .ipynb file and creating a pull request to add it to the docs folder.'), AlpacaItem(instruction='What steps should contributors take to verify their development environment is correctly set up?', input='', output='To verify that the development environment is correctly set up, contributors should:\\n1. Run `pytest .` to ensure all tests pass successfully.\\n2. Check that all necessary dependencies are installed by executing `poetry install --with dev,docs -E all`.'), AlpacaItem(instruction='How can contributors handle feedback during the code review process?', input='', output='Contributors can handle feedback during the code review process by:\\n1. Addressing all feedback provided by reviewers, discussing any disagreements respectfully.\\n2. Making necessary updates to the code based on reviewer comments.\\n3. Keeping communication open and responsive to facilitate a smooth review.'), AlpacaItem(instruction='What are the principles to follow when writing cookbook entries for CAMEL?', input='', output='The principles to follow when writing cookbook entries for CAMEL include:\\n1. Ensuring high quality with accurate code and well-written explanations.\\n2. Validating LLM-generated responses with real-world examples.\\n3. Making sure all code is reproducible and accessible to a wide range of users.'), AlpacaItem(instruction='How can contributors ensure the reproducibility of their code in CAMEL?', input='', output='Contributors can ensure the reproducibility of their code in CAMEL by:\\n1. Writing clear documentation that outlines the steps needed to run the code.\\n2. Validating that all code snippets produce consistent results when executed.'), AlpacaItem(instruction='Describe the steps for conducting a sprint review in CAMEL.', input='', output='The steps for conducting a sprint review in CAMEL include:\\n1. Gathering stakeholders to review the features delivered during the sprint.\\n2. Providing feedback on the completed work and discussing areas for improvement.\\n3. Documenting feedback for future reference and adjustments.'), AlpacaItem(instruction='What is the significance of using the `logger` in CAMEL instead of print statements?', input='', output='Using the `logger` in CAMEL instead of print statements is significant because:\\n1. It ensures consistent and configurable logging across the application.\\n2. It allows for different logging levels (e.g., info, debug) to manage output effectively.'), AlpacaItem(instruction='What are the common pitfalls to avoid during code reviews in CAMEL?', input='', output='Common pitfalls to avoid during code reviews in CAMEL include:\\n1. Submitting large PRs; instead, break down changes into smaller, manageable PRs.\\n2. Ignoring feedback from reviewers; discuss any disagreements instead of dismissing them.'), AlpacaItem(instruction='How should contributors document their code changes in CAMEL?', input='', output='Contributors should document their code changes in CAMEL by:\\n1. Writing clear and detailed commit messages that explain the purpose of the changes.\\n2. Including comments within the code to clarify complex logic or functionality.'), AlpacaItem(instruction='What is the recommended approach for updating dependencies in CAMEL?', input='', output='The recommended approach for updating dependencies in CAMEL includes:\\n1. Modifying the `pyproject.toml` file as needed.\\n2. Running `poetry lock` to synchronize dependencies with the lock file.'), AlpacaItem(instruction='Explain how to build documentation locally for CAMEL.', input='', output='To build documentation locally for CAMEL, follow these steps:\\n1. Navigate to the `docs` directory using `cd docs`.\\n2. Run the command `make html` to generate the HTML documentation.'), AlpacaItem(instruction='What are the steps for running unit tests in CAMEL?', input='', output='The steps for running unit tests in CAMEL include:\\n1. Activating the virtual environment with `poetry shell`.\\n2. Running all tests using the command `pytest .`.'), AlpacaItem(instruction='How can contributors ensure their contributions are recognized?', input='', output='Contributors can ensure their contributions are recognized by:\\n1. Informing maintainers of their Twitter handle for acknowledgment in releases.\\n2. Engaging with the community and participating in discussions.'), AlpacaItem(instruction=\"What is the purpose of the `Common Actions` section in CAMEL's documentation?\", input='', output=\"The purpose of the `Common Actions` section in CAMEL's documentation is to provide quick reference instructions for routine tasks such as updating dependencies, running tests, and generating coverage reports.\"), AlpacaItem(instruction='Describe the importance of accessibility in CAMEL documentation.', input='', output=\"Accessibility in CAMEL documentation is important because it ensures that users of all skill levels can understand and utilize the project's features effectively, fostering a more inclusive community.\"), AlpacaItem(instruction='What are the steps for integrating a new feature into CAMEL?', input='', output='The steps for integrating a new feature into CAMEL include:\\n1. Designing the feature and writing the code according to project guidelines.\\n2. Writing unit tests to cover the new functionality.\\n3. Submitting a pull request and addressing any feedback from reviewers.'), AlpacaItem(instruction='How can contributors maintain high-quality contributions to CAMEL?', input='', output='Contributors can maintain high-quality contributions to CAMEL by:\\n1. Following established coding standards and guidelines.\\n2. Writing thorough tests and documentation for their changes.'), AlpacaItem(instruction='What is the role of the `contributing` document in CAMEL?', input='', output='The `contributing` document in CAMEL serves as a guide for potential contributors, outlining the processes, standards, and expectations for contributing to the project.'), AlpacaItem(instruction='Explain the significance of using version control in CAMEL.', input='', output=\"Using version control in CAMEL is significant because it allows for tracking changes, collaborating efficiently among contributors, and maintaining a history of the project's evolution.\"), AlpacaItem(instruction='What should contributors do if they encounter issues during the setup process?', input='', output='If contributors encounter issues during the setup process, they should reach out to a maintainer for assistance to ensure a smooth experience.'), AlpacaItem(instruction='How can contributors effectively communicate during team meetings?', input='', output='Contributors can effectively communicate during team meetings by:\\n1. Preparing updates on their work ahead of time.\\n2. Actively engaging in discussions and providing constructive feedback.'), AlpacaItem(instruction='What are the steps for running pre-commit hooks in CAMEL?', input='', output='The steps for running pre-commit hooks in CAMEL include:\\n1. Installing the pre-commit hook with `pre-commit install`.\\n2. Running the pre-commit checks with `pre-commit run --all-files` before pushing changes.'), AlpacaItem(instruction=\"What is the purpose of the `Licensing` section in CAMEL's documentation?\", input='', output=\"The purpose of the `Licensing` section in CAMEL's documentation is to inform contributors about the licensing terms under which the project's source code is released and how to apply licenses to their contributions.\"), AlpacaItem(instruction='How can contributors provide feedback on existing documentation in CAMEL?', input='', output='Contributors can provide feedback on existing documentation in CAMEL by commenting on relevant issues or pull requests, or directly suggesting changes through pull requests.'), AlpacaItem(instruction='What is the significance of the `Giving Credit` section in CAMEL?', input='', output=\"The significance of the `Giving Credit` section in CAMEL is to acknowledge contributors' efforts and enhance community engagement by recognizing their contributions publicly.\"), AlpacaItem(instruction='How can contributors ensure their code is modular and maintainable?', input='', output='Contributors can ensure their code is modular and maintainable by:\\n1. Structuring code into reusable components and functions.\\n2. Avoiding duplication and adhering to design patterns.'), AlpacaItem(instruction='What are the benefits of participating in developer meetings for CAMEL?', input='', output='Participating in developer meetings for CAMEL offers benefits such as:\\n1. Staying informed about project updates and changes.\\n2. Collaborating with team members to address challenges and brainstorm solutions.'), AlpacaItem(instruction='How can contributors improve the quality of their code submissions?', input='', output='Contributors can improve the quality of their code submissions by:\\n1. Conducting thorough testing and validation of their code before submission.\\n2. Seeking feedback from peers to identify areas for improvement.'), AlpacaItem(instruction=\"What is the purpose of the `Developer Meeting Time & Link` section in CAMEL's documentation?\", input='', output=\"The purpose of the `Developer Meeting Time & Link` section in CAMEL's documentation is to provide contributors with information about scheduled meetings where they can discuss project updates and collaborate.\"), AlpacaItem(instruction='Explain how to address security vulnerabilities in CAMEL code.', input='', output='To address security vulnerabilities in CAMEL code, contributors should:\\n1. Review code for potential security risks and follow secure coding practices.\\n2. Test for vulnerabilities and apply necessary patches promptly.'), AlpacaItem(instruction=\"What is the role of the `Common Actions` section in CAMEL's documentation?\", input='', output=\"The role of the `Common Actions` section in CAMEL's documentation is to provide quick reference instructions for routine tasks such as updating dependencies, running tests, and generating coverage reports.\"), AlpacaItem(instruction='How can contributors effectively manage their time during sprints?', input='', output='Contributors can effectively manage their time during sprints by:\\n1. Prioritizing tasks based on importance and deadlines.\\n2. Breaking down larger tasks into smaller, manageable parts.'), AlpacaItem(instruction='What steps should contributors take when they want to report a bug in CAMEL?', input='', output='When reporting a bug in CAMEL, contributors should:\\n1. Create a new issue on GitHub with a clear title and description.\\n2. Include steps to reproduce the bug and any relevant context.'), AlpacaItem(instruction='What are the benefits of using Google Colab for cookbook contributions?', input='', output='The benefits of using Google Colab for cookbook contributions include:\\n1. The ability to run interactive code alongside explanations, enhancing practical understanding.\\n2. Easy sharing and collaboration on notebook entries with other contributors.'), AlpacaItem(instruction='How can contributors ensure their documentation is accessible?', input='', output='Contributors can ensure their documentation is accessible by:\\n1. Using clear and simple language to explain complex concepts.\\n2. Including examples and visuals to aid understanding.'), AlpacaItem(instruction='What is the significance of the `Code Review Checklist` in CAMEL?', input='', output='The significance of the `Code Review Checklist` in CAMEL is to provide reviewers with a structured approach to evaluate code submissions, ensuring consistency and quality across the project.')]\n"
     ]
    }
   ],
   "source": [
    "import random\n",
    "firecrawl = Firecrawl()\n",
    "# Scrape and clean content from a specified URL\n",
    "response = firecrawl.scrape(\n",
    "    url=\"https://github.com/camel-ai/camel/blob/master/CONTRIBUTING.md\"\n",
    ")\n",
    "\n",
    "# Generate the items 50 a time up to 300\n",
    "alpaca_entries = []\n",
    "for start in range(1, 301, 50):\n",
    "    # Combine default examples with random samples from previous generations\n",
    "    current_examples = examples + (random.sample(alpaca_entries,\n",
    "                                                 min(5, len(alpaca_entries)))\n",
    "                                                  if alpaca_entries else [])\n",
    "\n",
    "    batch = generate_alpaca_items(\n",
    "        content=response[\"markdown\"],\n",
    "        n_items=50,\n",
    "        start_num=start,\n",
    "        examples=current_examples\n",
    "    )\n",
    "    print(f\"Generated {len(batch)} items\")\n",
    "    alpaca_entries.extend(batch)\n",
    "\n",
    "print(alpaca_entries)\n",
    "save_json(alpaca_entries, 'alpaca_format_data.json')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "-va4lzdi0eYj"
   },
   "source": [
    "Now to define how each row is formatted"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "6jGOhVcFTMh7"
   },
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 81,
     "referenced_widgets": [
      "72c0de91c56a44d98659b972c8f0e97a",
      "7eb28cf244ed4619aad56f467e25ce26",
      "17111fa945714687862836cc96a56f76",
      "54169765e20c43afae89a04772c56742",
      "1147ac3c309940e4a1ca8949c1da9753",
      "2167aef214ee4cf4aab1afd7a4b10521",
      "c242e6bb882b49a1b8a0f4a4ca31899d",
      "f723884c70244dbdbaa52591e86ecff7",
      "72315666ad874bce939bbefd0c48ae39",
      "17828defc86242038773e74d6650467f",
      "97971303d3314ece96a700bafd11b529",
      "d9124ec9b5894754a1d6bb092937313b",
      "e5bc24e6cbf34b0db72adfe6c83d86a7",
      "6ddabd7faafc4b2491bd69c0cdb65bbc",
      "b6daa80ad2f4415a8a1765b3ce054250",
      "c7a7a22b2a8745298c99ee53f1750947",
      "baf661a9c91b419aa3a6885fd222ab63",
      "ebb09c0335a14e3380b66095ed36abdd",
      "6f7a81506dd742158830be2348521765",
      "a0b267894c5241618feb0a45c05a2079",
      "5eb1525baca0455781d781431ed6ed58",
      "acda9d6ab69f4909b345b146235bbc2b"
     ]
    },
    "id": "LjY75GoYUCB8",
    "outputId": "c726dbfd-ec08-49ae-870f-6fa5c3c8b930"
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "72c0de91c56a44d98659b972c8f0e97a",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Generating train split: 0 examples [00:00, ? examples/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "d9124ec9b5894754a1d6bb092937313b",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Map:   0%|          | 0/290 [00:00<?, ? examples/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "EOS_TOKEN = tokenizer.eos_token\n",
    "\n",
    "# Provide function showing how to convert dataset row into inference text\n",
    "def formatting_prompts_func(dataset_row):\n",
    "    return {\n",
    "        \"text\": [\n",
    "            AlpacaItem(instruction=inst, input=inp, output=out)\n",
    "                        .to_string() + EOS_TOKEN # Use handy to_string method\n",
    "            for inst, inp, out in zip(\n",
    "                dataset_row[\"instruction\"],\n",
    "                dataset_row[\"input\"],\n",
    "                dataset_row[\"output\"]\n",
    "            )\n",
    "        ]\n",
    "    }\n",
    "\n",
    "from datasets import load_dataset\n",
    "dataset = load_dataset(\"json\", data_files=\"alpaca_format_data.json\", split=\"train\")\n",
    "dataset = dataset.map(formatting_prompts_func, batched = True,)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "idAEIeSQ3xdS"
   },
   "source": [
    "Train the model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 49,
     "referenced_widgets": [
      "b6c1200afe7245f7b046170414dac7b3",
      "6e573fe458bd4c0d98823c70a790da60",
      "d2d13cc0548e4967ad0d092501db2c81",
      "c11844fb1a734a16b860f0440e8cffdf",
      "606486ae3acb4d95ab4221ca114e963c",
      "da838d96f35e4c18baa6893ae4845a56",
      "0197c07e81c242998ada352a35f39f8f",
      "d4bac08e57cc4e27b2c78f3fa43e2c28",
      "990f2df2a6274d44be95a25f5cd86374",
      "2a4e264be88f4b12811d5629f68e87b8",
      "32cb19cd97a342d58e62321f6a535977"
     ]
    },
    "id": "95_Nn-89DhsL",
    "outputId": "f5e12877-564f-4142-e79f-fcb748c7328a"
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "b6c1200afe7245f7b046170414dac7b3",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Generating train split: 0 examples [00:00, ? examples/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from trl import SFTTrainer\n",
    "from transformers import TrainingArguments\n",
    "from unsloth import is_bfloat16_supported\n",
    "trainer = SFTTrainer(\n",
    "    model = model,\n",
    "    tokenizer = tokenizer,\n",
    "    train_dataset = dataset,\n",
    "    dataset_text_field = \"text\",\n",
    "    max_seq_length = 1024,\n",
    "    dataset_num_proc = 2,\n",
    "    packing = True, # Packs short sequences together to save time!\n",
    "    args = TrainingArguments(\n",
    "        per_device_train_batch_size = 2,\n",
    "        gradient_accumulation_steps = 4,\n",
    "        warmup_steps = 5,\n",
    "        num_train_epochs = 20,\n",
    "        learning_rate = 0.001,\n",
    "        fp16 = not is_bfloat16_supported(),\n",
    "        bf16 = is_bfloat16_supported(),\n",
    "        logging_steps = 1,\n",
    "        optim = \"adamw_8bit\",\n",
    "        weight_decay = 0.01,\n",
    "        lr_scheduler_type = \"linear\",\n",
    "        seed = 3407,\n",
    "        output_dir = \"outputs\",\n",
    "        report_to = \"none\", # Use this for WandB etc\n",
    "    ),\n",
    ")\n",
    "# Ensure model is fully back in training mode\n",
    "model = FastLanguageModel.for_training(model)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 1000
    },
    "id": "yqxqAZ7KJ4oL",
    "outputId": "c6f6c0a9-5a47-4106-c4f0-2c5474ff0d5d"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "==((====))==  Unsloth - 2x faster free finetuning | Num GPUs = 1\n",
      "   \\\\   /|    Num examples = 21 | Num Epochs = 20\n",
      "O^O/ \\_/ \\    Batch size per device = 2 | Gradient Accumulation steps = 4\n",
      "\\        /    Total batch size = 8 | Total steps = 40\n",
      " \"-____-\"     Number of trainable parameters = 304,087,040\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "\n",
       "    <div>\n",
       "      \n",
       "      <progress value='40' max='40' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
       "      [40/40 15:55, Epoch 19/20]\n",
       "    </div>\n",
       "    <table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       " <tr style=\"text-align: left;\">\n",
       "      <th>Step</th>\n",
       "      <th>Training Loss</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>7.342400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>7.534600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>9.473700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>4.720600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5</td>\n",
       "      <td>5.680200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6</td>\n",
       "      <td>3.815700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>7</td>\n",
       "      <td>5.580000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>8</td>\n",
       "      <td>4.242500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>9</td>\n",
       "      <td>5.318600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>10</td>\n",
       "      <td>4.605900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>11</td>\n",
       "      <td>5.133800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>12</td>\n",
       "      <td>3.160600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>13</td>\n",
       "      <td>2.873900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>14</td>\n",
       "      <td>2.490700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>15</td>\n",
       "      <td>2.824400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>16</td>\n",
       "      <td>8.742200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>17</td>\n",
       "      <td>11.397600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>18</td>\n",
       "      <td>3.157300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>19</td>\n",
       "      <td>3.475900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>20</td>\n",
       "      <td>2.405500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>21</td>\n",
       "      <td>1.764400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>22</td>\n",
       "      <td>4.982500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>23</td>\n",
       "      <td>3.095300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>24</td>\n",
       "      <td>1.628900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>25</td>\n",
       "      <td>1.476900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>26</td>\n",
       "      <td>0.821400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>27</td>\n",
       "      <td>0.791900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>28</td>\n",
       "      <td>0.864900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>29</td>\n",
       "      <td>0.781200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>30</td>\n",
       "      <td>0.491400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>31</td>\n",
       "      <td>0.648500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>32</td>\n",
       "      <td>0.412500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>33</td>\n",
       "      <td>0.450900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>34</td>\n",
       "      <td>0.313500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>35</td>\n",
       "      <td>0.394900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>36</td>\n",
       "      <td>0.227000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>37</td>\n",
       "      <td>0.213300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>38</td>\n",
       "      <td>0.202700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>39</td>\n",
       "      <td>0.190500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>40</td>\n",
       "      <td>0.086400</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table><p>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "dtrainer_stats = trainer.train()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "ekOmTR1hSNcr"
   },
   "source": [
    "<a name=\"Inference\"></a>\n",
    "### Inference\n",
    "Let's run the model! You can change the instruction and input - leave the output blank!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "kR3gIAX-SM2q",
    "outputId": "4a94b91e-43ef-4cee-a412-f5d9ea6a10bb"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['<s> ### Instruction:\\nExplain how can I stay up to date with the CAMEL community.\\n\\n### Input:\\n\\n\\n### Response:\\nTo ensure that contributors can keep informed about upcoming meetings and community engagement, the CAMEL community emphasizes the importance of joining communication channels such as Discord, WeChat, and Slack.</s>']"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",
    "inputs = tokenizer(\n",
    "[\n",
    "\n",
    "    AlpacaItem(\n",
    "        instruction=\"Explain how can I stay up to date with the CAMEL community.\",\n",
    "        input=\"\",\n",
    "        output=\"\", # leave this blank for generation!\n",
    "    ).to_string()\n",
    "\n",
    "], return_tensors = \"pt\").to(\"cuda\")\n",
    "\n",
    "outputs = model.generate(**inputs, max_new_tokens = 512, use_cache = True)\n",
    "tokenizer.batch_decode(outputs)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "xSepmhPrgOct"
   },
   "source": [
    "**Summary**\n",
    "\n",
    "\n",
    "We have generated realistic user queries and responses from a real page and trained on them to produce a model that understands the underlying content."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "W69RaTFiREDc"
   },
   "source": [
    "That's everything: Got questions about 🐫 CAMEL-AI? Join us on [Discord](https://discord.camel-ai.org)! Whether you want to share feedback, explore the latest in multi-agent systems, get support, or connect with others on exciting projects, we’d love to have you in the community! 🤝\n",
    "\n",
    "Check out some of our other work:\n",
    "\n",
    "1. 🐫 Creating Your First CAMEL Agent [free Colab](https://docs.camel-ai.org/cookbooks/create_your_first_agent.html)\n",
    "\n",
    "2.  Graph RAG Cookbook [free Colab](https://colab.research.google.com/drive/1uZKQSuu0qW6ukkuSv9TukLB9bVaS1H0U?usp=sharing)\n",
    "\n",
    "3. 🧑‍⚖️ Create A Hackathon Judge Committee with Workforce [free Colab](https://colab.research.google.com/drive/18ajYUMfwDx3WyrjHow3EvUMpKQDcrLtr?usp=sharing)\n",
    "\n",
    "4. 🔥 3 ways to ingest data from websites with Firecrawl & CAMEL [free Colab](https://colab.research.google.com/drive/1lOmM3VmgR1hLwDKdeLGFve_75RFW0R9I?usp=sharing)\n",
    "\n",
    "5. 🦥 Agentic SFT Data Generation with CAMEL and Meta Models, Fine-Tuned with Unsloth [free Colab](https://colab.research.google.com/drive/1fdBns2QA1XNwF_tsvG3Hc27QGdViHH3b?usp=sharing)\n",
    "\n",
    "6. 🦥 Agentic SFT Data Generation with CAMEL and Qwen Models, Fine-Tuned with Unsloth [free Colab](https://colab.research.google.com/drive/1sMnWOvdmASEMhsRIOUSAeYuEywby6FRV?usp=sharing)\n",
    "\n",
    "Thanks from everyone at 🐫 CAMEL-AI\n",
    "\n",
    "\n",
    "<div class=\"align-center\">\n",
    "  <a href=\"https://www.camel-ai.org/\"><img src=\"https://i.postimg.cc/KzQ5rfBC/button.png\"width=\"150\"></a>\n",
    "  <a href=\"https://discord.camel-ai.org\"><img src=\"https://i.postimg.cc/L4wPdG9N/join-2.png\"  width=\"150\"></a></a>\n",
    "  \n",
    "⭐ <i>Star us on [*Github*](https://github.com/camel-ai/camel), join our [*Discord*](https://discord.camel-ai.org) or follow our [*X*](https://x.com/camelaiorg)\n",
    "</div>"
   ]
  }
 ],
 "metadata": {
  "accelerator": "GPU",
  "colab": {
   "provenance": []
  },
  "kernelspec": {
   "display_name": "Python 3",
   "name": "python3"
  },
  "language_info": {
   "name": "python"
  },
  "widgets": {
   "application/vnd.jupyter.widget-state+json": {
    "0179fd870ce04ab78d916c4111cd79a8": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "0197c07e81c242998ada352a35f39f8f": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "025aad4d520a4c12be40b1ec60965f78": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_7ebfbbf5b43a4ef5a951363d6701baaa",
      "max": 2132,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_2b3aa959d2d74d569b6e060dd8a65687",
      "value": 2132
     }
    },
    "040ab5df78b041ccbd8bd8d1eab1accc": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_d1d69e6a21fd4a468c2103977d69a7fd",
      "placeholder": "​",
      "style": "IPY_MODEL_49d898b037f340aa9f05bb1fd7511628",
      "value": " 493k/493k [00:00&lt;00:00, 12.1MB/s]"
     }
    },
    "04c4fc581add4f23b99ada998599a342": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "0a8761d8502540439cda9ccb39e46d15": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "0d9bb083a6b7410a98be4058306c1b7e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "0ef0b079a60a481bb471db824c63614c": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "1147ac3c309940e4a1ca8949c1da9753": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "17111fa945714687862836cc96a56f76": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_f723884c70244dbdbaa52591e86ecff7",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_72315666ad874bce939bbefd0c48ae39",
      "value": 1
     }
    },
    "17828defc86242038773e74d6650467f": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "196c370e59814c4d94b91fecce193e1f": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_04c4fc581add4f23b99ada998599a342",
      "placeholder": "​",
      "style": "IPY_MODEL_4f71f21a05124dfdb2d29f64de18bc79",
      "value": "model.safetensors: 100%"
     }
    },
    "1a443295c0be4725869a94d9413d63fa": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_850910a24d794c60b518d6b3ce30c0f1",
      "max": 438,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_a87e42ebb8a9415197c4cd2d24ab156d",
      "value": 438
     }
    },
    "2167aef214ee4cf4aab1afd7a4b10521": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2592bd11c93e4efd9caaec3c041e4d40": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2a4e264be88f4b12811d5629f68e87b8": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2b3aa959d2d74d569b6e060dd8a65687": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "2f4a07efa98f4243b6f780793820bd70": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2f7eba09d59342b2909b77f0339cb61e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "31faaf9cf2d2410a8189bc048d1f4759": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_7b3946f6cd584e1fbd584dd350c1cc31",
       "IPY_MODEL_ed44806f6ae34cbaa96da955530f25af",
       "IPY_MODEL_040ab5df78b041ccbd8bd8d1eab1accc"
      ],
      "layout": "IPY_MODEL_2592bd11c93e4efd9caaec3c041e4d40"
     }
    },
    "32447f1a28fa435bbf4a943274047f06": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "32cb19cd97a342d58e62321f6a535977": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "386534e2ee6245d4931abf5a9a366dec": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "danger",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_7ae08cc6b65548189cff799d47b929a2",
      "max": 4125687698,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_c62a747103824874aade983876e872b4",
      "value": 4125687305
     }
    },
    "4526ec1d4ec745b1bc49be760743bf45": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_53f5d541916943569bc8b1b11f8af8e3",
      "placeholder": "​",
      "style": "IPY_MODEL_ac212a92b6214af49730678dff56dd80",
      "value": "tokenizer_config.json: 100%"
     }
    },
    "49d898b037f340aa9f05bb1fd7511628": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "4d9ad5bbe7ea487b849b589dd8405a86": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "4f71f21a05124dfdb2d29f64de18bc79": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "52e1ab786d8d4514907d3c9b519eea86": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_e7e2b3e9223c42798ba0a3a34eb1d71e",
      "placeholder": "​",
      "style": "IPY_MODEL_d542ac82ac354efc8231698f59e91da8",
      "value": " 4.13G/4.13G [00:35&lt;00:00, 437MB/s]"
     }
    },
    "53b4571358fc49e881f7583475315de2": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "53f5d541916943569bc8b1b11f8af8e3": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "54169765e20c43afae89a04772c56742": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_17828defc86242038773e74d6650467f",
      "placeholder": "​",
      "style": "IPY_MODEL_97971303d3314ece96a700bafd11b529",
      "value": " 290/0 [00:00&lt;00:00, 2419.24 examples/s]"
     }
    },
    "5eb1525baca0455781d781431ed6ed58": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "606486ae3acb4d95ab4221ca114e963c": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "63e2e4d767044da8b2c2caacecfa8b53": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_fbd55bebf3644df692e661e02c5d9b7c",
      "placeholder": "​",
      "style": "IPY_MODEL_2f7eba09d59342b2909b77f0339cb61e",
      "value": " 155/155 [00:00&lt;00:00, 11.2kB/s]"
     }
    },
    "67eacf7bcab7461fad095a715ce1fb76": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "6ddabd7faafc4b2491bd69c0cdb65bbc": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_6f7a81506dd742158830be2348521765",
      "max": 290,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_a0b267894c5241618feb0a45c05a2079",
      "value": 290
     }
    },
    "6e573fe458bd4c0d98823c70a790da60": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_da838d96f35e4c18baa6893ae4845a56",
      "placeholder": "​",
      "style": "IPY_MODEL_0197c07e81c242998ada352a35f39f8f",
      "value": "Generating train split: "
     }
    },
    "6f7a81506dd742158830be2348521765": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "72315666ad874bce939bbefd0c48ae39": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "72c0de91c56a44d98659b972c8f0e97a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_7eb28cf244ed4619aad56f467e25ce26",
       "IPY_MODEL_17111fa945714687862836cc96a56f76",
       "IPY_MODEL_54169765e20c43afae89a04772c56742"
      ],
      "layout": "IPY_MODEL_1147ac3c309940e4a1ca8949c1da9753"
     }
    },
    "77823f5661cd413c922db91a1883f3af": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "7ae08cc6b65548189cff799d47b929a2": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "7b3946f6cd584e1fbd584dd350c1cc31": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_8daa9ffcf5874c68b82ba7d6bad2afd9",
      "placeholder": "​",
      "style": "IPY_MODEL_8da629cd46b34cb5a7a533b31756caab",
      "value": "tokenizer.model: 100%"
     }
    },
    "7d8fb825409241fe8c854bf6635ed0c6": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "7eb28cf244ed4619aad56f467e25ce26": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_2167aef214ee4cf4aab1afd7a4b10521",
      "placeholder": "​",
      "style": "IPY_MODEL_c242e6bb882b49a1b8a0f4a4ca31899d",
      "value": "Generating train split: "
     }
    },
    "7ebfbbf5b43a4ef5a951363d6701baaa": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "7f9d7ebc992e4ffdaeb040d3a3b37b41": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "850910a24d794c60b518d6b3ce30c0f1": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "8a72479983604802acb0450e2f075d72": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "8af7e959a0894c4eaebcc756186969e4": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "8da629cd46b34cb5a7a533b31756caab": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "8daa9ffcf5874c68b82ba7d6bad2afd9": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "945b1d65759a46f896dac5dc510435f8": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_4526ec1d4ec745b1bc49be760743bf45",
       "IPY_MODEL_025aad4d520a4c12be40b1ec60965f78",
       "IPY_MODEL_f97151ccc3124f7598acb926a0b70711"
      ],
      "layout": "IPY_MODEL_0179fd870ce04ab78d916c4111cd79a8"
     }
    },
    "97971303d3314ece96a700bafd11b529": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "990f2df2a6274d44be95a25f5cd86374": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "9feb96a46c524916a4d77410a42573ff": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "9ffe1c53f79e462a972456c9263011d5": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "a0b267894c5241618feb0a45c05a2079": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "a3ef9ae9c03e4562b0f1133305795cdf": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_a64abdcfa37447749b8df3ee3ac3343c",
       "IPY_MODEL_1a443295c0be4725869a94d9413d63fa",
       "IPY_MODEL_bc6ee36df75b4c2bb40ebc1c7e030341"
      ],
      "layout": "IPY_MODEL_0a8761d8502540439cda9ccb39e46d15"
     }
    },
    "a64abdcfa37447749b8df3ee3ac3343c": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_8a72479983604802acb0450e2f075d72",
      "placeholder": "​",
      "style": "IPY_MODEL_8af7e959a0894c4eaebcc756186969e4",
      "value": "special_tokens_map.json: 100%"
     }
    },
    "a87e42ebb8a9415197c4cd2d24ab156d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "a9e83f8d7f3e4f8681ac6a23fabce60e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_d3ad2412060f48bdbf069711d20fa44d",
      "placeholder": "​",
      "style": "IPY_MODEL_d9a964938105455ba2b4ff8e0f9bdb21",
      "value": " 1.80M/1.80M [00:00&lt;00:00, 2.58MB/s]"
     }
    },
    "ac212a92b6214af49730678dff56dd80": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "acc7efcd0fe243c19633e91a754d65de": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "acda9d6ab69f4909b345b146235bbc2b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "af88ce43bc6c4537a6107733bfc6d8f5": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "afdac2c6f67049a9b00c7d8499198f4d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_196c370e59814c4d94b91fecce193e1f",
       "IPY_MODEL_386534e2ee6245d4931abf5a9a366dec",
       "IPY_MODEL_52e1ab786d8d4514907d3c9b519eea86"
      ],
      "layout": "IPY_MODEL_2f4a07efa98f4243b6f780793820bd70"
     }
    },
    "b41dd2e291b64862aca912a7641cbffb": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "b6c1200afe7245f7b046170414dac7b3": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_6e573fe458bd4c0d98823c70a790da60",
       "IPY_MODEL_d2d13cc0548e4967ad0d092501db2c81",
       "IPY_MODEL_c11844fb1a734a16b860f0440e8cffdf"
      ],
      "layout": "IPY_MODEL_606486ae3acb4d95ab4221ca114e963c"
     }
    },
    "b6daa80ad2f4415a8a1765b3ce054250": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_5eb1525baca0455781d781431ed6ed58",
      "placeholder": "​",
      "style": "IPY_MODEL_acda9d6ab69f4909b345b146235bbc2b",
      "value": " 290/290 [00:00&lt;00:00, 8924.12 examples/s]"
     }
    },
    "b89a1c85fa0d44d9ade2f2d149e84019": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_77823f5661cd413c922db91a1883f3af",
      "max": 155,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_7f9d7ebc992e4ffdaeb040d3a3b37b41",
      "value": 155
     }
    },
    "baf661a9c91b419aa3a6885fd222ab63": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "bc6ee36df75b4c2bb40ebc1c7e030341": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_0ef0b079a60a481bb471db824c63614c",
      "placeholder": "​",
      "style": "IPY_MODEL_32447f1a28fa435bbf4a943274047f06",
      "value": " 438/438 [00:00&lt;00:00, 30.4kB/s]"
     }
    },
    "c11844fb1a734a16b860f0440e8cffdf": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_2a4e264be88f4b12811d5629f68e87b8",
      "placeholder": "​",
      "style": "IPY_MODEL_32cb19cd97a342d58e62321f6a535977",
      "value": " 21/0 [00:00&lt;00:00, 203.91 examples/s]"
     }
    },
    "c20970bea6f14a6eb13f9bb38732fb05": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "c242e6bb882b49a1b8a0f4a4ca31899d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "c62a747103824874aade983876e872b4": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "c7a7a22b2a8745298c99ee53f1750947": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "c9a6a1c8c96c4cdba555697372bafb74": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_53b4571358fc49e881f7583475315de2",
      "placeholder": "​",
      "style": "IPY_MODEL_7d8fb825409241fe8c854bf6635ed0c6",
      "value": "generation_config.json: 100%"
     }
    },
    "d1d69e6a21fd4a468c2103977d69a7fd": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "d2d13cc0548e4967ad0d092501db2c81": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_d4bac08e57cc4e27b2c78f3fa43e2c28",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_990f2df2a6274d44be95a25f5cd86374",
      "value": 1
     }
    },
    "d3ad2412060f48bdbf069711d20fa44d": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "d4bac08e57cc4e27b2c78f3fa43e2c28": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": "20px"
     }
    },
    "d542ac82ac354efc8231698f59e91da8": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "d9124ec9b5894754a1d6bb092937313b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_e5bc24e6cbf34b0db72adfe6c83d86a7",
       "IPY_MODEL_6ddabd7faafc4b2491bd69c0cdb65bbc",
       "IPY_MODEL_b6daa80ad2f4415a8a1765b3ce054250"
      ],
      "layout": "IPY_MODEL_c7a7a22b2a8745298c99ee53f1750947"
     }
    },
    "d9a964938105455ba2b4ff8e0f9bdb21": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "da838d96f35e4c18baa6893ae4845a56": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "e47421fec52c494598cc4c6c49641030": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_c9a6a1c8c96c4cdba555697372bafb74",
       "IPY_MODEL_b89a1c85fa0d44d9ade2f2d149e84019",
       "IPY_MODEL_63e2e4d767044da8b2c2caacecfa8b53"
      ],
      "layout": "IPY_MODEL_e9d91ef8c01d42e6bf7cd4cf263026f4"
     }
    },
    "e5bc24e6cbf34b0db72adfe6c83d86a7": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_baf661a9c91b419aa3a6885fd222ab63",
      "placeholder": "​",
      "style": "IPY_MODEL_ebb09c0335a14e3380b66095ed36abdd",
      "value": "Map: 100%"
     }
    },
    "e7e2b3e9223c42798ba0a3a34eb1d71e": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "e9d91ef8c01d42e6bf7cd4cf263026f4": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "ebb09c0335a14e3380b66095ed36abdd": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "ed44806f6ae34cbaa96da955530f25af": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_9feb96a46c524916a4d77410a42573ff",
      "max": 493443,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_9ffe1c53f79e462a972456c9263011d5",
      "value": 493443
     }
    },
    "ed6e77f6ef45430fabd16bf3a5d6d4dd": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_f8a429b61bea4a9b8c78f80e6b00d6da",
       "IPY_MODEL_fd83b0e954bd4ce680cb14c0fbe2a9c7",
       "IPY_MODEL_a9e83f8d7f3e4f8681ac6a23fabce60e"
      ],
      "layout": "IPY_MODEL_acc7efcd0fe243c19633e91a754d65de"
     }
    },
    "f723884c70244dbdbaa52591e86ecff7": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": "20px"
     }
    },
    "f8a429b61bea4a9b8c78f80e6b00d6da": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_c20970bea6f14a6eb13f9bb38732fb05",
      "placeholder": "​",
      "style": "IPY_MODEL_b41dd2e291b64862aca912a7641cbffb",
      "value": "tokenizer.json: 100%"
     }
    },
    "f97151ccc3124f7598acb926a0b70711": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_4d9ad5bbe7ea487b849b589dd8405a86",
      "placeholder": "​",
      "style": "IPY_MODEL_0d9bb083a6b7410a98be4058306c1b7e",
      "value": " 2.13k/2.13k [00:00&lt;00:00, 116kB/s]"
     }
    },
    "fbd55bebf3644df692e661e02c5d9b7c": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "fd83b0e954bd4ce680cb14c0fbe2a9c7": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_af88ce43bc6c4537a6107733bfc6d8f5",
      "max": 1795188,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_67eacf7bcab7461fad095a715ce1fb76",
      "value": 1795188
     }
    }
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}
